-- Logs begin at Wed 2022-05-18 14:03:10 UTC, end at Wed 2022-05-18 15:14:07 UTC. -- May 18 14:40:33.542981 dv-cinder-839987-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 18 14:40:33.550213 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 14:40:33 2022] *** May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: nodename: dv-cinder-839987-7-iscsi May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: machine: x86_64 May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: clock source: unix May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: pcre jit disabled May 18 14:40:33.552204 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: detected number of CPU cores: 4 May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: current working directory: / May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: detected binary path: /usr/bin/uwsgi-core May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: your processes number limit is 47680 May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: your memory page size is 4096 bytes May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: detected max file descriptor number: 2048 May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: lock engine: pthread robust mutexes May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: thunder lock: enabled May 18 14:40:33.552743 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 18 14:40:33.555138 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 14:40:33.601881 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: Python main interpreter initialized at 0x563f69c1f9c0 May 18 14:40:33.601881 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: python threads support enabled May 18 14:40:33.601881 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: your server socket listen backlog is limited to 100 connections May 18 14:40:33.601881 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: your mercy for graceful operations on workers is 90 seconds May 18 14:40:33.602259 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: mapped 403077 bytes (393 KB) for 2 cores May 18 14:40:33.602375 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: *** Operational MODE: preforking *** May 18 14:40:33.603237 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: *** uWSGI is running in multiple interpreter mode *** May 18 14:40:33.603237 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: spawned uWSGI master process (pid: 86715) May 18 14:40:33.603435 dv-cinder-839987-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 18 14:40:33.604249 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: spawned uWSGI worker 1 (pid: 86727, cores: 1) May 18 14:40:33.604346 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: spawned uWSGI worker 2 (pid: 86728, cores: 1) May 18 14:40:33.605274 dv-cinder-839987-7-iscsi devstack@keystone.service[86715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 14:40:39.319168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:40:39.319168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: from cryptography.utils import int_from_bytes May 18 14:40:39.319919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:40:39.319919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: from cryptography.utils import int_from_bytes May 18 14:40:39.322574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:40:39.322574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: from cryptography.utils import int_from_bytes May 18 14:40:39.323012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 14:40:39.323012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: from cryptography.utils import int_from_bytes May 18 14:40:39.369019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 14:40:39.369211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 14:40:39.369320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 14:40:39.369420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] command line args: [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 14:40:39.369504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 14:40:39.369668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 14:40:39.369749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] command line args: [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 14:40:39.369847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ================================================================================ {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 14:40:39.369967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 14:40:39.370101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] admin_token = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ================================================================================ {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 14:40:39.370347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] config_dir = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] admin_token = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] config_dir = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] config_source = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] debug = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.370965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] config_source = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] debug = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371872 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.371977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] list_limit = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] list_limit = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] log_config_append = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] log_config_append = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.372967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] log_dir = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] log_dir = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] log_file = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] log_file = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.373940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.374973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.375978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.376141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.376229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.376416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.376514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.376925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] publish_errors = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] publish_errors = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.377999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] standard_threads = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] standard_threads = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.378998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] use_journal = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] use_journal = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] use_json = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] use_json = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] use_stderr = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] use_stderr = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] use_syslog = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] use_syslog = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.379978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.380061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 14:40:39.380233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.380320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.380470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.380548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.380758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.380856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.380996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381246 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.381953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.382923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.383009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.383167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.383247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.383402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.383480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.384174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.384260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.384425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.384505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.384686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.384768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.384944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.385926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.386991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.387931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.388887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.389993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.390989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.391977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.392951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.393988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.394930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.395019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.395162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.395242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.395397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.395511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.395631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.395749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396005 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.396975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.397972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.398922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.399010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.399184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.399798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.399961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.400942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.401932 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.402901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.403967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.404927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.405893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] auth.external = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] auth.external = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.406909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] auth.password = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] auth.password = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] auth.token = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] auth.token = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.407881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.408843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] credential.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] credential.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.409961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.410998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.411989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.412159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.412242 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.412416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.412496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.412701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.412785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.412942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.413932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.414949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.415946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.416100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.416181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.416349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.416432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.416599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.416684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.416866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.417201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.417354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.417434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.417591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.417673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.417825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.417905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.418860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.419951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.420030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.420196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.420287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.420447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.420613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.420744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.420873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.421936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.422972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.423100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.423228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.423355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.423501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.423630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.423758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.423886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.424946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.425084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.425214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.425353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.425479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.425614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.425742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.425878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.426909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.427967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.428095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.428231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.428362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.428491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.428634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.428775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.428915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.429950 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.430075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.430198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.430323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.430933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431207 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.431968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.432093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.432217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.432342 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.432473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.432655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.432781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.432910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.433949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.434087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.434217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.434344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.434476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.434604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.434742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.434923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.435995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.436122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.436250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.436378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.436513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.436664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.436790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.436920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.437988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.438125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.438256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.438385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.438524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.438653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.438783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.438921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.439051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.439180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.439309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.439468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.439594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.439790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.439918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.440983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.441109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.441234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.441378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.441505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.441631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.441758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.441883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] role.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.442918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] role.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] role.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] role.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.443941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.444068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.444193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.444324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.444466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.444644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.444770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.444900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.445942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.446107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.446739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.446866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.446995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.447125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.447262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.447390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.447519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.447653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.447779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.447918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.448971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.449998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.450994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.451971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.452884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.453997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454420 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454541 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.454994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.455123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.455255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.455381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.455506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.455645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.455645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.455891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.connection = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.connection = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.456965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.457095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.457224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.457351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.457480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.457615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.457756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.457884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.458924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.459053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.459189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.459324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.459462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.459590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.459718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.459849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.460052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.460183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.460311 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.460440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.460568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.460751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.460893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.461022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.461151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 14:40:39.461278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.461278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 14:40:39.461278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 14:40:39.487709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.487896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.487896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.488143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.488278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.488425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.497346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.497487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.525903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.526212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.526316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.526449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.579452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.579662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.629877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.630109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.630912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.631219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.695979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.696758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.696922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.697035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.697205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.697290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.697424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.697639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.697732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.697972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.698252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.698544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.720743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.720980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.721949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.722079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.722171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.722302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.733466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.733848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.748489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.748691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.748784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.748920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749010 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.749951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.750029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 14:40:39.767402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.767614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 14:40:39.767700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.767883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 14:40:39.767967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.768135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 14:40:39.768218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.768404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 14:40:39.768487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.768696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.768782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.768954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.769038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.769206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.769299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.769456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.780191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.780471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.780554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.780764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.780865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.781032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.781115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.781311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.789128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.789415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.793232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.793510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.793595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.793789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.793880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.794067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.794177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.794457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.794540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.794715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.794810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.794984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.795067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.795247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.795328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.795512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.795594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.795777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.795858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.796038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.796126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.796299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.823112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.823249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.824741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.824896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.825019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.825174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.830284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.830431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.830566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.830711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.830847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.830994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.838162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.838305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.838443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.838586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.843058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.843194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.843344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.843480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.843624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.843762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.843905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.844045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.844179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.844321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.844451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.844616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.844743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.844890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.845012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.845159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.864219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.864374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.864495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.864674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.869705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.869801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.873371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.873456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.873666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.873762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.878689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.878775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.882333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.882417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.886579 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.886877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.886966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.887160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.887425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.887644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.887777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.887861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.887969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.888042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.888251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.888689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.907353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.907727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.907997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.908269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.908497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.908899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.909171 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.909445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.916774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.918167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.918759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.919034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.919887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.920166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.922128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.922408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.922697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.922979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.923255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.923382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.923523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.923820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.924104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.924379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.937290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.937571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.937851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.938127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.938307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.938449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.938581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.938706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.938856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.938994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.939133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.939406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.939679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.939955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.956964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.958085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.960234 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.961369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.963600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.964729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.965240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.966328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.966893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.967182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.967464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.967980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.968268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.968550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.974882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.975937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.976494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.978111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.980272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.980560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.980873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.981153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.981367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.981655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.981947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.982226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.990358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.990652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.990934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.991431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.991724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.992004 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:39.999562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:39.999807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.000085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.000357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.000483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 14:40:40.000652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.000781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.000927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.001971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.002148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.002274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.002423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.002549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.002673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.002797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.002930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.003056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.003182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.003306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.003553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.003813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 14:40:40.042861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563f69c1f9c0 pid: 86728 (default app) May 18 14:40:40.043580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563f69c1f9c0 pid: 86727 (default app) May 18 14:40:40.046209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb427200-ff31-407f-b326-0a7b6ce7f294 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:40.046507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb427200-ff31-407f-b326-0a7b6ce7f294 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:40.046789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb427200-ff31-407f-b326-0a7b6ce7f294 None None] PATH_INFO: `/v3` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:40.050961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Wed May 18 14:40:40 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:48.103755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411931-9b61-4878-b385-4f35bff88203 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:48.104329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411931-9b61-4878-b385-4f35bff88203 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:48.104329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411931-9b61-4878-b385-4f35bff88203 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:48.108598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:40:48.113806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:48.114239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:48.114356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:48.182218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: INFO dbcounter [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] Registered counter for database keystone May 18 14:40:48.203847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG oslo_db.sqlalchemy.engines [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:40:48.210460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writer thread running {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:40:48.390787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG passlib.handlers.bcrypt [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86728) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 14:40:48.391116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG passlib.handlers.bcrypt [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86728) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 14:40:48.447094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:48.448699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:48.569018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 18 14:40:48.736012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411931-9b61-4878-b385-4f35bff88203 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:48.806745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: INFO dbcounter [None req-36411931-9b61-4878-b385-4f35bff88203 None None] Registered counter for database keystone May 18 14:40:48.825979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG oslo_db.sqlalchemy.engines [None req-36411931-9b61-4878-b385-4f35bff88203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 14:40:48.832119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writer thread running {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 14:40:48.953159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411931-9b61-4878-b385-4f35bff88203 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:48.957499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da434-e92b-4107-94b2-798d7937e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:48.958160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da434-e92b-4107-94b2-798d7937e792 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:48.958450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da434-e92b-4107-94b2-798d7937e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:48.958732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da434-e92b-4107-94b2-798d7937e792 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:48.967539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da434-e92b-4107-94b2-798d7937e792 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:49.022691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7d5da434-e92b-4107-94b2-798d7937e792 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 14:40:49.022982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da434-e92b-4107-94b2-798d7937e792 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:49.034983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Wed May 18 14:40:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:40:49.041502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:49.056212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c27b2-142b-44a5-a64e-c6904113e74b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:49.060684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d963306-034a-4563-9de7-751ec00f0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:49.061803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963306-034a-4563-9de7-751ec00f0834 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:49.062090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963306-034a-4563-9de7-751ec00f0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:49.062368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963306-034a-4563-9de7-751ec00f0834 admin admin] PATH_INFO: `/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:49.063887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d963306-034a-4563-9de7-751ec00f0834 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e866db7b1bd46b4b3abe110fcb71b70)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:49.236080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6d963306-034a-4563-9de7-751ec00f0834 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 14:40:49.236668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d963306-034a-4563-9de7-751ec00f0834 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:49.241140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Wed May 18 14:40:49 2022] GET /identity/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:51.441690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b12c-bae3-4a37-b93f-846fbef5e364 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:51.442216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b12c-bae3-4a37-b93f-846fbef5e364 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:51.442321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091b12c-bae3-4a37-b93f-846fbef5e364 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:51.446438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:40:51.451887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3244d73-036d-4216-a6f8-7f76d5f96f61 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:51.452309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3244d73-036d-4216-a6f8-7f76d5f96f61 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:51.452457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3244d73-036d-4216-a6f8-7f76d5f96f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:51.471970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e3244d73-036d-4216-a6f8-7f76d5f96f61 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:51.473547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e3244d73-036d-4216-a6f8-7f76d5f96f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:51.481939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 18 14:40:51.503191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091b12c-bae3-4a37-b93f-846fbef5e364 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:51.515137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091b12c-bae3-4a37-b93f-846fbef5e364 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:51.519400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f914608-163a-4e69-bf75-cc6b70a7aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:51.520029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914608-163a-4e69-bf75-cc6b70a7aa1c admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:51.520321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914608-163a-4e69-bf75-cc6b70a7aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:51.520627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914608-163a-4e69-bf75-cc6b70a7aa1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:51.528829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914608-163a-4e69-bf75-cc6b70a7aa1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:51.530591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914608-163a-4e69-bf75-cc6b70a7aa1c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:51.539405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Wed May 18 14:40:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:40:51.545397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3244d73-036d-4216-a6f8-7f76d5f96f61 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:51.554167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3244d73-036d-4216-a6f8-7f76d5f96f61 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:51.558524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7dffbd-c236-4cef-b421-fc27507244e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:51.559385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dffbd-c236-4cef-b421-fc27507244e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:51.559669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dffbd-c236-4cef-b421-fc27507244e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:51.559950 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7dffbd-c236-4cef-b421-fc27507244e1 admin admin] PATH_INFO: `/v3/users/6bb17e1228d44efb843bda521c27b495` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:51.561364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dffbd-c236-4cef-b421-fc27507244e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=6bb17e1228d44efb843bda521c27b495)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:51.563185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7dffbd-c236-4cef-b421-fc27507244e1 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:51.564761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Wed May 18 14:40:51 2022] GET /identity/v3/users/6bb17e1228d44efb843bda521c27b495 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:53.832945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2238-499b-41b9-b7e4-926c14ec1750 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:53.833447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2238-499b-41b9-b7e4-926c14ec1750 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:53.833554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2238-499b-41b9-b7e4-926c14ec1750 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:53.835053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:53.839951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc9aee-52da-4020-970c-71c870704ecb None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:53.840331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc9aee-52da-4020-970c-71c870704ecb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:53.840669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc9aee-52da-4020-970c-71c870704ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:53.857276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5ddc9aee-52da-4020-970c-71c870704ecb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:53.858450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5ddc9aee-52da-4020-970c-71c870704ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:53.893854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60a4c-e1d9-4a3e-965f-fbc2da97912a None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:53.894149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60a4c-e1d9-4a3e-965f-fbc2da97912a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:53.894440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60a4c-e1d9-4a3e-965f-fbc2da97912a None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:53.895790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:53.900785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:53.901081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:53.901364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:53.939597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:40:53.941324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG passlib.handlers.bcrypt [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86727) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 14:40:53.941755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG passlib.handlers.bcrypt [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86727) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 14:40:53.963636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc9aee-52da-4020-970c-71c870704ecb None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:53.988912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:53.992380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:53.994578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:54.069248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc9aee-52da-4020-970c-71c870704ecb None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.095439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:40:54.103979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.104942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.105233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.105519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.116526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:40:54.118314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:40:54.128602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:40:54.129648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:40:54.130469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:40:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:40:54.136167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:54.223440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:54.243461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cac93-2eb7-41e2-b997-a839a8081f46 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.280353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.281053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.281345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.281629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.282393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:40:54.282711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:54.284120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:54.296834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:40:54.302307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:54.333899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370974-c663-4005-9bd0-b1dbb19e5d68 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.336956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:54.373035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.373864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.374154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.374432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.400419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6e6a-8561-4bb4-bea6-cefdcbccfed2 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.434980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.435855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.436146 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.436432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] PATH_INFO: `/v3/users/6bb17e1228d44efb843bda521c27b495` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.437672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb17e1228d44efb843bda521c27b495)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:54.439148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:54.440751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:54.440895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 9/16] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:40:54 2022] GET /identity/v3/users/6bb17e1228d44efb843bda521c27b495 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:40:54.442414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:54.446091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:54.459936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:54.542616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 14:40:54.546343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6461b-0bf7-4141-b691-261b9ce69260 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.548064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:54.550729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:54.581338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.582229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.582520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.582799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.583991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:54.585492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:54.587630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 10/18] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:40:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:40:54.593275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:54.643925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257806f-cef8-44dc-8b59-d6e3b0a82bd6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.672834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:54.679515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.680351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.680660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.680946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.692413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8999e66-e713-4b3f-be00-9352d4b7b2d9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.699605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:54.701118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:40:54.722732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:40:54.723643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:40:54.724457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:40:54.724457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:40:54.724457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:40:54.724457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:40:54.724457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 9/19] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:40:54.731092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24774d-73e9-4427-b022-62d2ae02a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.731333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:54.731756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24774d-73e9-4427-b022-62d2ae02a20f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.732045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24774d-73e9-4427-b022-62d2ae02a20f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.732326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24774d-73e9-4427-b022-62d2ae02a20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.733217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24774d-73e9-4427-b022-62d2ae02a20f None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.domain.id=default, user.id=6bb17e1228d44efb843bda521c27b495) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:40:54.733534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24774d-73e9-4427-b022-62d2ae02a20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:54.735023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24774d-73e9-4427-b022-62d2ae02a20f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:54.742056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1322 bytes} [Wed May 18 14:40:54 2022] GET /identity/v3/role_assignments?user.id=6bb17e1228d44efb843bda521c27b495&scope.domain.id=default&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:40:54.793244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:54.839756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca70a9-e85a-4d63-abd8-9bc8454a2a9a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:54.874860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4307f88-d13e-495c-bef3-78bf0403a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:54.875555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307f88-d13e-495c-bef3-78bf0403a523 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:54.875844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307f88-d13e-495c-bef3-78bf0403a523 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:54.876129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307f88-d13e-495c-bef3-78bf0403a523 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:54.876910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4307f88-d13e-495c-bef3-78bf0403a523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:40:54.877227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4307f88-d13e-495c-bef3-78bf0403a523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:54.878654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4307f88-d13e-495c-bef3-78bf0403a523 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:54.908709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:40:57.098564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa23ec5-7d8e-48b5-ad0f-02f407245c70 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.099614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa23ec5-7d8e-48b5-ad0f-02f407245c70 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.100108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa23ec5-7d8e-48b5-ad0f-02f407245c70 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.101727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:57.107836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7f95-f5db-4dd9-b968-b654295e776b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.108662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7f95-f5db-4dd9-b968-b654295e776b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.109220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7f95-f5db-4dd9-b968-b654295e776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.127561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-554c7f95-f5db-4dd9-b968-b654295e776b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:57.129203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-554c7f95-f5db-4dd9-b968-b654295e776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:57.199032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:40:57.258140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa23ec5-7d8e-48b5-ad0f-02f407245c70 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:57.381813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa23ec5-7d8e-48b5-ad0f-02f407245c70 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:57.432712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:57.433528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.433821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.434101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.449842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:40:57.457736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:40:57.458594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:40:57.459756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 13/24] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:40:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:40:57.466967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7f95-f5db-4dd9-b968-b654295e776b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:57.531012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:57.589539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7f95-f5db-4dd9-b968-b654295e776b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:57.637599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e08e37-d301-4da1-83b7-64751f05d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:57.638663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08e37-d301-4da1-83b7-64751f05d950 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.639156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08e37-d301-4da1-83b7-64751f05d950 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.639630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08e37-d301-4da1-83b7-64751f05d950 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.640659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e08e37-d301-4da1-83b7-64751f05d950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:40:57.641208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e08e37-d301-4da1-83b7-64751f05d950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:57.642826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e08e37-d301-4da1-83b7-64751f05d950 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:57.659502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 12/25] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:40:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:57.666137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:57.676604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:57.824167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819d3cf-ccbd-4278-b365-f4af46a88a6c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:57.854226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b9ac-2661-402d-bd4a-c9bd67c2022c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.854869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b9ac-2661-402d-bd4a-c9bd67c2022c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.855372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b9ac-2661-402d-bd4a-c9bd67c2022c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.856948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 13/26] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:57.872280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d037-695b-4fa6-b9e9-9d6931b1a00d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.872610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d037-695b-4fa6-b9e9-9d6931b1a00d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.872886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d037-695b-4fa6-b9e9-9d6931b1a00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.885861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb073-5ec5-4a47-84f4-a0750c970475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:57.886757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb073-5ec5-4a47-84f4-a0750c970475 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.887053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb073-5ec5-4a47-84f4-a0750c970475 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.887338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb073-5ec5-4a47-84f4-a0750c970475 None admin] PATH_INFO: `/v3/users/6bb17e1228d44efb843bda521c27b495` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.889946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceb073-5ec5-4a47-84f4-a0750c970475 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb17e1228d44efb843bda521c27b495)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:57.891372 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceb073-5ec5-4a47-84f4-a0750c970475 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:57.893385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 14/27] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:40:57 2022] GET /identity/v3/users/6bb17e1228d44efb843bda521c27b495 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:57.895686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeec29-a92f-4d8c-a858-34cab8f5ca54 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:57.895986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeec29-a92f-4d8c-a858-34cab8f5ca54 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:57.896274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeec29-a92f-4d8c-a858-34cab8f5ca54 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:57.897676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 15/28] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:57.904647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeec29-a92f-4d8c-a858-34cab8f5ca54 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:57.911077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7cb6d037-695b-4fa6-b9e9-9d6931b1a00d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:57.912504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7cb6d037-695b-4fa6-b9e9-9d6931b1a00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:58.025162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:58.043879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 14/29] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:40:58.045463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f9329-d1dc-4c80-a7f4-ab6a1eb73acd None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.045762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f9329-d1dc-4c80-a7f4-ab6a1eb73acd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.046048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f9329-d1dc-4c80-a7f4-ab6a1eb73acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.047206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeec29-a92f-4d8c-a858-34cab8f5ca54 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:58.063340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-447f9329-d1dc-4c80-a7f4-ab6a1eb73acd None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:58.064558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-447f9329-d1dc-4c80-a7f4-ab6a1eb73acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:58.086360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53039641-84f6-42d2-85cf-6e2e862d7618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:58.088064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039641-84f6-42d2-85cf-6e2e862d7618 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.088567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039641-84f6-42d2-85cf-6e2e862d7618 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.089085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039641-84f6-42d2-85cf-6e2e862d7618 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.090510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53039641-84f6-42d2-85cf-6e2e862d7618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:58.092205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53039641-84f6-42d2-85cf-6e2e862d7618 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:58.094390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 16/30] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:58.095956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b540f-e774-4a7b-b168-cdd39a17dbfd None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.096504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b540f-e774-4a7b-b168-cdd39a17dbfd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.097255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:58.098435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b540f-e774-4a7b-b168-cdd39a17dbfd None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.100379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 17/31] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:58.102084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b540f-e774-4a7b-b168-cdd39a17dbfd None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:58.152677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 15/32] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:40:58.152677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f9329-d1dc-4c80-a7f4-ab6a1eb73acd None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:58.249738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b540f-e774-4a7b-b168-cdd39a17dbfd None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:58.279119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f9329-d1dc-4c80-a7f4-ab6a1eb73acd None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:58.297379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8b0c-5a6b-4584-81ac-03d2b967ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:58.298854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8b0c-5a6b-4584-81ac-03d2b967ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.299333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8b0c-5a6b-4584-81ac-03d2b967ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.299801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8b0c-5a6b-4584-81ac-03d2b967ffe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.312824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:58.316724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8b0c-5a6b-4584-81ac-03d2b967ffe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:58.316838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:58.317772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.318098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.318448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] PATH_INFO: `/v3/domains/default/users/6bb17e1228d44efb843bda521c27b495/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.319349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8b0c-5a6b-4584-81ac-03d2b967ffe8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:58.321890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6bb17e1228d44efb843bda521c27b495, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:58.324693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-d89e8b0c-5a6b-4584-81ac-03d2b967ffe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:40:58.343621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:40:58.344468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:40:58.345374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:40:58.345374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:40:58.345374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:40:58.345374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:40:58.347710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 18/33] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:40:58.349419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108420e-c90b-4343-a27e-c49bf44b5f0b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.349917 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108420e-c90b-4343-a27e-c49bf44b5f0b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.350485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108420e-c90b-4343-a27e-c49bf44b5f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.368534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5108420e-c90b-4343-a27e-c49bf44b5f0b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:58.370069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5108420e-c90b-4343-a27e-c49bf44b5f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:58.440233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 19/34] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:40:58.441540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108420e-c90b-4343-a27e-c49bf44b5f0b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:58.474732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 16/35] 10.222.0.59 () {58 vars in 1361 bytes} [Wed May 18 14:40:58 2022] PUT /identity/v3/domains/default/users/6bb17e1228d44efb843bda521c27b495/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:40:58.476149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:58.556301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:58.612652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108420e-c90b-4343-a27e-c49bf44b5f0b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:58.662930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:58.682940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:58.683203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.683434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.683720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.684738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:58.686100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:58.691024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6668e-987d-4e28-b852-8ee1e2d89d34 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:58.733744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:58.734653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:58.735240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:58.735708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:58.736631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:40:58.737148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:58.738922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:58.755919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 17/36] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:58.757047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:58.828635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 20/37] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 18 14:40:58 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:40:58.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:58.892212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:58.932018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed185-7734-454c-a3f0-12cdf7e06c3f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:59.031911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e964d7-1880-4168-8806-9f58f5623e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:59.032715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e964d7-1880-4168-8806-9f58f5623e93 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.033005 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e964d7-1880-4168-8806-9f58f5623e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.033285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e964d7-1880-4168-8806-9f58f5623e93 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.034067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e964d7-1880-4168-8806-9f58f5623e93 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:59.035487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e964d7-1880-4168-8806-9f58f5623e93 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:59.079214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e1aa7-5c39-458b-b5eb-893e4bb3315e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:59.080791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 18/38] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 18 14:40:58 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:40:59.127234 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d6a7e-9b90-4611-a3be-ad64ddc6609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:59.128790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6a7e-9b90-4611-a3be-ad64ddc6609a None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.129400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6a7e-9b90-4611-a3be-ad64ddc6609a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.129908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6a7e-9b90-4611-a3be-ad64ddc6609a None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.130964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d6a7e-9b90-4611-a3be-ad64ddc6609a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:59.133056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d6a7e-9b90-4611-a3be-ad64ddc6609a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:59.175683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 21/39] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:40:58 2022] POST /identity/v3/projects => generated 301 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:40:59.179491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b838b6-712e-436a-a2a2-fde131aeb38a None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.180037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b838b6-712e-436a-a2a2-fde131aeb38a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.180111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b838b6-712e-436a-a2a2-fde131aeb38a None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.181867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 19/40] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:59.188331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0858f-870a-4c61-a0f3-41e779fec0fb None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.194066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0858f-870a-4c61-a0f3-41e779fec0fb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.194521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0858f-870a-4c61-a0f3-41e779fec0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.222183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-20d0858f-870a-4c61-a0f3-41e779fec0fb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:59.224763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-20d0858f-870a-4c61-a0f3-41e779fec0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:59.261645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:59.315070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 22/41] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:40:59.343538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b838b6-712e-436a-a2a2-fde131aeb38a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:59.424629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7380-9347-41d1-80d5-eba5f937be01 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.425248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7380-9347-41d1-80d5-eba5f937be01 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.425725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7380-9347-41d1-80d5-eba5f937be01 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.427308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 23/42] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:40:59.433273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1074852-c2c3-458a-9c90-abe547909e6a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.433870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1074852-c2c3-458a-9c90-abe547909e6a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.434388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1074852-c2c3-458a-9c90-abe547909e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.455756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b1074852-c2c3-458a-9c90-abe547909e6a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:40:59.457328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b1074852-c2c3-458a-9c90-abe547909e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:40:59.485519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b838b6-712e-436a-a2a2-fde131aeb38a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:59.535070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:59.535754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.536041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.536321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.537159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:59.538565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:59.545297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 24/43] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:40:59.556159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 20/44] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 18 14:40:59 2022] POST /identity/v3/roles => generated 223 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:40:59.579046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1074852-c2c3-458a-9c90-abe547909e6a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:59.688518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:59.697648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1074852-c2c3-458a-9c90-abe547909e6a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:59.734307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270823-7797-433f-8afc-f6e44d35336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:59.735179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270823-7797-433f-8afc-f6e44d35336b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.735470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270823-7797-433f-8afc-f6e44d35336b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.736784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270823-7797-433f-8afc-f6e44d35336b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.737106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b270823-7797-433f-8afc-f6e44d35336b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:59.738702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b270823-7797-433f-8afc-f6e44d35336b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:59.740917 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 25/45] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:40:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:40:59.746662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:40:59.758950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:40:59.848346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd892178-74cd-4abb-bfee-d15cc59a1891 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:40:59.880320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f715ba-d447-4299-afe6-ccd34e74325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:40:59.881009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f715ba-d447-4299-afe6-ccd34e74325c None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:40:59.881300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f715ba-d447-4299-afe6-ccd34e74325c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:40:59.881580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f715ba-d447-4299-afe6-ccd34e74325c None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:40:59.882294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f715ba-d447-4299-afe6-ccd34e74325c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:40:59.884341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f715ba-d447-4299-afe6-ccd34e74325c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:40:59.911652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 21/46] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:40:59 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:41:01.092175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f020dc-b091-4a62-8263-954eecf31ed5 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:01.092724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f020dc-b091-4a62-8263-954eecf31ed5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:01.092834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f020dc-b091-4a62-8263-954eecf31ed5 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:01.094151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 26/47] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:01.099349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58c37-c6d4-4a9c-b3e0-0e2669c55c54 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:01.099723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58c37-c6d4-4a9c-b3e0-0e2669c55c54 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:01.099925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58c37-c6d4-4a9c-b3e0-0e2669c55c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:01.116772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b8e58c37-c6d4-4a9c-b3e0-0e2669c55c54 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:01.118330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b8e58c37-c6d4-4a9c-b3e0-0e2669c55c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:01.173844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:01.186136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 22/48] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:01.211587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f020dc-b091-4a62-8263-954eecf31ed5 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:01.311489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f020dc-b091-4a62-8263-954eecf31ed5 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:01.354492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:01.355594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:01.356022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:01.356442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:01.372691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:01.383722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:01.384553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:01.385351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:01.385940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 27/49] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:01.391208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e58c37-c6d4-4a9c-b3e0-0e2669c55c54 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:01.487852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e58c37-c6d4-4a9c-b3e0-0e2669c55c54 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:01.521638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:01.522310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:01.522600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:01.522883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:01.523659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:01.523975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:01.525408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:01.533553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 23/50] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:01.539086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:01.564562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:01.639954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9051341-d946-4517-8f23-8e855b44ad82 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:01.673065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:01.673954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:01.674244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:01.674527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] PATH_INFO: `/v3/users/6bb17e1228d44efb843bda521c27b495` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:01.675733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb17e1228d44efb843bda521c27b495)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:01.677304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:01.678935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 28/51] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:01 2022] GET /identity/v3/users/6bb17e1228d44efb843bda521c27b495 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:01.684941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:01.738116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:01.784097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b3d9f-b031-4e8d-af34-6e5899a498d6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:01.817624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48136f5b-b5ad-41b2-87bf-005df735dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:01.818432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48136f5b-b5ad-41b2-87bf-005df735dd48 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:01.818730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48136f5b-b5ad-41b2-87bf-005df735dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:01.819018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48136f5b-b5ad-41b2-87bf-005df735dd48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:01.820203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48136f5b-b5ad-41b2-87bf-005df735dd48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:01.821735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48136f5b-b5ad-41b2-87bf-005df735dd48 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:01.823361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 24/52] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:01.828991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:01.917044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:01.926896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2118be2-7343-41fa-b40e-d02ad4848540 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:01.970422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bf3c-7372-4035-b259-101ea604afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:01.971791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf3c-7372-4035-b259-101ea604afae None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:01.971791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf3c-7372-4035-b259-101ea604afae None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:01.971791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf3c-7372-4035-b259-101ea604afae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:01.972649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bf3c-7372-4035-b259-101ea604afae None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.domain.id=default, user.id=6bb17e1228d44efb843bda521c27b495) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:01.972973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bf3c-7372-4035-b259-101ea604afae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:01.974501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bf3c-7372-4035-b259-101ea604afae None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:01.981978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 29/53] 10.222.0.59 () {56 vars in 1322 bytes} [Wed May 18 14:41:01 2022] GET /identity/v3/role_assignments?user.id=6bb17e1228d44efb843bda521c27b495&scope.domain.id=default&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:02.174156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc8fe-26bd-4657-a5d2-59742a063945 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:02.174651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc8fe-26bd-4657-a5d2-59742a063945 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:02.174746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc8fe-26bd-4657-a5d2-59742a063945 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:02.176119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 25/54] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:02.181572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c366-644f-42a9-a33c-0b2e1eb56d5f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:02.181995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c366-644f-42a9-a33c-0b2e1eb56d5f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:02.182205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c366-644f-42a9-a33c-0b2e1eb56d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:02.199501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-26a8c366-644f-42a9-a33c-0b2e1eb56d5f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:02.200738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-26a8c366-644f-42a9-a33c-0b2e1eb56d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:02.268134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 30/55] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:02.291906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc8fe-26bd-4657-a5d2-59742a063945 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:02.391883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc8fe-26bd-4657-a5d2-59742a063945 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:02.410990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:02.425019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e6b53-3efd-42b5-a41f-c7b3d211924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:02.425747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6b53-3efd-42b5-a41f-c7b3d211924a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:02.426034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6b53-3efd-42b5-a41f-c7b3d211924a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:02.426316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6b53-3efd-42b5-a41f-c7b3d211924a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:02.427490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e6b53-3efd-42b5-a41f-c7b3d211924a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:02.428959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e6b53-3efd-42b5-a41f-c7b3d211924a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:02.430584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 26/56] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:02.436052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c366-644f-42a9-a33c-0b2e1eb56d5f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:02.514956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:02.530975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c366-644f-42a9-a33c-0b2e1eb56d5f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:02.563388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae5141-110e-489a-9f09-514d9230d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:02.564036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5141-110e-489a-9f09-514d9230d78c None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:02.564321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5141-110e-489a-9f09-514d9230d78c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:02.564620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5141-110e-489a-9f09-514d9230d78c None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:02.565342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5141-110e-489a-9f09-514d9230d78c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:02.566782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5141-110e-489a-9f09-514d9230d78c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:02.591370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 31/57] 10.222.0.59 () {60 vars in 1140 bytes} [Wed May 18 14:41:02 2022] POST /identity/v3/projects => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:04.780938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5af18-4e34-435a-9f5f-fbfe944fe837 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:04.781462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5af18-4e34-435a-9f5f-fbfe944fe837 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:04.781560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5af18-4e34-435a-9f5f-fbfe944fe837 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:04.782890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 27/58] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:04.788176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99812dc8-d159-447c-9266-eb4841a68ee9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:04.788623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99812dc8-d159-447c-9266-eb4841a68ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:04.788779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99812dc8-d159-447c-9266-eb4841a68ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:04.805432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-99812dc8-d159-447c-9266-eb4841a68ee9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:04.806632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-99812dc8-d159-447c-9266-eb4841a68ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:04.870930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 32/59] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:04.894935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5af18-4e34-435a-9f5f-fbfe944fe837 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:04.994906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5af18-4e34-435a-9f5f-fbfe944fe837 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:05.027169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9e20-0890-4654-8bf8-4140d9ec7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:05.027954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9e20-0890-4654-8bf8-4140d9ec7890 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:05.028247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9e20-0890-4654-8bf8-4140d9ec7890 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:05.028528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9e20-0890-4654-8bf8-4140d9ec7890 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:05.029745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f9e20-0890-4654-8bf8-4140d9ec7890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:05.031283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f9e20-0890-4654-8bf8-4140d9ec7890 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:05.032873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 28/60] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:05.038165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99812dc8-d159-447c-9266-eb4841a68ee9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:05.100895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:05.140647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99812dc8-d159-447c-9266-eb4841a68ee9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:05.173658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6956cfd-6ab2-4f1b-9d9a-c4623b42a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:05.174330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6956cfd-6ab2-4f1b-9d9a-c4623b42a83b None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:05.174619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6956cfd-6ab2-4f1b-9d9a-c4623b42a83b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:05.174902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6956cfd-6ab2-4f1b-9d9a-c4623b42a83b None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:05.175624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6956cfd-6ab2-4f1b-9d9a-c4623b42a83b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:05.177130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6956cfd-6ab2-4f1b-9d9a-c4623b42a83b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:05.204142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 33/61] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:41:05 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:08.607959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5c4fd-98ea-44b8-934f-49631c0e03cf None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:08.608963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5c4fd-98ea-44b8-934f-49631c0e03cf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:08.609482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5c4fd-98ea-44b8-934f-49631c0e03cf None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:08.611175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 29/62] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:08.617089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c77c4-5477-4ea8-b663-128d64c77557 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:08.618073 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c77c4-5477-4ea8-b663-128d64c77557 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:08.618597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c77c4-5477-4ea8-b663-128d64c77557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:08.640573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-605c77c4-5477-4ea8-b663-128d64c77557 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:08.641838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-605c77c4-5477-4ea8-b663-128d64c77557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:08.715252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 34/63] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:08.750960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5c4fd-98ea-44b8-934f-49631c0e03cf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:08.779498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a089f31-5cbf-4681-ba61-ac8bec41dc0a None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:08.780151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a089f31-5cbf-4681-ba61-ac8bec41dc0a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:08.780674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a089f31-5cbf-4681-ba61-ac8bec41dc0a None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:08.782274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 35/64] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:08.787284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ed12-ee5d-4789-9321-0fddc467c3ca None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:08.787920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ed12-ee5d-4789-9321-0fddc467c3ca None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:08.788425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ed12-ee5d-4789-9321-0fddc467c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:08.807094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-bf29ed12-ee5d-4789-9321-0fddc467c3ca None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:08.808621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bf29ed12-ee5d-4789-9321-0fddc467c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:08.856380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:08.889788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:08.917613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 36/65] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:08.919195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d49491-4471-4fbb-bd54-ed5bd1cb01f2 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:08.919643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d49491-4471-4fbb-bd54-ed5bd1cb01f2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:08.920230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d49491-4471-4fbb-bd54-ed5bd1cb01f2 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:08.921989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 37/66] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:08.930351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d8fa-d419-4c71-bc36-15303fd20688 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:08.930892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d8fa-d419-4c71-bc36-15303fd20688 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:08.931385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d8fa-d419-4c71-bc36-15303fd20688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:08.932063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5c4fd-98ea-44b8-934f-49631c0e03cf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:08.956996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-89f5d8fa-d419-4c71-bc36-15303fd20688 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:08.958531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-89f5d8fa-d419-4c71-bc36-15303fd20688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:08.974595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:08.975584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:08.975882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:08.976168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:08.993606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:09.003294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:09.004207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:09.005037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:09.007414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 30/67] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:09.009101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.040630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 38/68] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:09.045200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d8fa-d419-4c71-bc36-15303fd20688 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.131677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea723-baef-4409-aa13-bd55c4c2a974 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.148522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.156949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d8fa-d419-4c71-bc36-15303fd20688 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.167020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524baa-841c-4326-a006-d72f2879ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.168103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524baa-841c-4326-a006-d72f2879ec84 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.168397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524baa-841c-4326-a006-d72f2879ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.168711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524baa-841c-4326-a006-d72f2879ec84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.173030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.178964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d524baa-841c-4326-a006-d72f2879ec84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-9d524baa-841c-4326-a006-d72f2879ec84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:09.187637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:09.188463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:09.189710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 31/69] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:09.193447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d02d-ecb0-40e2-abb4-27b0f5267602 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.193447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d02d-ecb0-40e2-abb4-27b0f5267602 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.193447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d02d-ecb0-40e2-abb4-27b0f5267602 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.194721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 32/70] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:09.195457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0d02d-ecb0-40e2-abb4-27b0f5267602 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.203302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.203992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.204286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.204572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.205796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:09.206116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:09.207910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:09.218532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 39/71] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:09.219369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.306605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0d02d-ecb0-40e2-abb4-27b0f5267602 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.322021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96b3e4-3fe2-4aa0-8853-03adbf193f03 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.339953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1b312-9b35-445a-b069-f028097a9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.340786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b312-9b35-445a-b069-f028097a9695 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.341081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b312-9b35-445a-b069-f028097a9695 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.341369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b312-9b35-445a-b069-f028097a9695 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.351264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1b312-9b35-445a-b069-f028097a9695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:09.354703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.355365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.355650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.355933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.356712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:09.357023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:09.358405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-eda1b312-9b35-445a-b069-f028097a9695 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:09.359536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:09.360348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:09.361159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 33/72] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:09.362262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e4332-dd52-4b3f-ac76-9d29b269bd42 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.362262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e4332-dd52-4b3f-ac76-9d29b269bd42 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.362508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e4332-dd52-4b3f-ac76-9d29b269bd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.366643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 40/73] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:09.368031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.380945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ff4e4332-dd52-4b3f-ac76-9d29b269bd42 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:09.382151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ff4e4332-dd52-4b3f-ac76-9d29b269bd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:09.401602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.411569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.452475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 34/74] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:09.453829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704e00-cc25-408e-be48-3d74e9dbe48d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.454126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704e00-cc25-408e-be48-3d74e9dbe48d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.454413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704e00-cc25-408e-be48-3d74e9dbe48d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.455715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 35/75] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:09.457325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704e00-cc25-408e-be48-3d74e9dbe48d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.482436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a7905-dde8-480c-8cde-d86eaeed4278 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.516343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.517260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.517553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.517839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.531589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:09.533113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:09.534791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 41/76] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:09.535567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.559701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704e00-cc25-408e-be48-3d74e9dbe48d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.592792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e9f65-6db9-4e50-b734-67d2e70e6eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.593451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9f65-6db9-4e50-b734-67d2e70e6eca None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.593738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9f65-6db9-4e50-b734-67d2e70e6eca None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.594014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e9f65-6db9-4e50-b734-67d2e70e6eca None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.594765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e9f65-6db9-4e50-b734-67d2e70e6eca None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:09.595076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e9f65-6db9-4e50-b734-67d2e70e6eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:09.596490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e9f65-6db9-4e50-b734-67d2e70e6eca None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:09.605028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 36/77] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:09.606259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de59a3-2ab6-4306-8236-72a0508f33d7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.606554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de59a3-2ab6-4306-8236-72a0508f33d7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.606835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de59a3-2ab6-4306-8236-72a0508f33d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.622933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-97de59a3-2ab6-4306-8236-72a0508f33d7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:09.624145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-97de59a3-2ab6-4306-8236-72a0508f33d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:09.627392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.634152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326c6bc-0300-44e6-ae82-acb3febfa14a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.646647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.671587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.672390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.674460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.674765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.676533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:09.678051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:09.684823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 42/78] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:09.684823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.695293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 37/79] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:09.697430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de59a3-2ab6-4306-8236-72a0508f33d7 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.787592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ce63-cc1e-4c72-bf0a-cac4fee1f939 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.797022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de59a3-2ab6-4306-8236-72a0508f33d7 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.821716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258d95-59a9-432b-89e0-442695868053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.822522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258d95-59a9-432b-89e0-442695868053 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.822822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258d95-59a9-432b-89e0-442695868053 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.823107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258d95-59a9-432b-89e0-442695868053 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.830448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.831102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.831392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.831678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.832993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258d95-59a9-432b-89e0-442695868053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-13258d95-59a9-432b-89e0-442695868053 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:09.840760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:09.841739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:09.842486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 43/80] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:09.843144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258d95-59a9-432b-89e0-442695868053 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:09.861861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.867612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:09.902921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:09.904410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:09.944203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258d95-59a9-432b-89e0-442695868053 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:09.977444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:09.978326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:09.978612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:09.978894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] PATH_INFO: `/v3/users/6bb17e1228d44efb843bda521c27b495` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:09.980099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] RBAC: Authorizing `identity:get_user(user_id=6bb17e1228d44efb843bda521c27b495)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:09.981656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:09.983293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 44/81] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/users/6bb17e1228d44efb843bda521c27b495 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:09.984068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.004355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 38/82] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:10.005234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.062228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.077007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.087292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6efac-bb4e-446b-8da1-91b14fb74f2a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.109163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93f10-b9a4-4c8b-a67a-44e067fbf9e6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.120642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.121302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.121595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.121996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.142267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.143057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.143350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.143628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.144829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.146297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.147918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 39/83] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:10.149321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.193643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.195196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.248567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf77dc-080a-4d1b-920e-2d2dcd750247 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.274485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.284029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.284156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.285149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.285525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.285848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.286897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:10.287207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.288601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.294791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 45/84] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:10.295601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.301224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 40/85] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:10.302311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.393051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8fa8-d727-4f1b-ab34-dd1a1515228b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.403583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742f12-08e8-4996-a93a-a625da7c7c34 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.426556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.427212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.427504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.427791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.436234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.437129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.437417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.437696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.438878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.440313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.442023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 41/86] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:10.442757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.489033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.497079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.501340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.502846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.540344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723fa43-ba06-4b63-b789-c1c3de59703c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.573808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.574479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.574770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.575055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.575776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.577247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.601222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 46/87] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:10.602606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.612778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 42/88] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:41:10 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:10.612778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.707762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.718006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f675a-3ed2-475f-a546-b76f8daf5dc8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.719897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db82a0-7ce1-466f-b79b-b039a1ebdf05 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.733228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:10.761215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.762006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.762291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.762572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.763406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.763817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.764304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.764626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.764902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.765361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.766185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.767270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 47/89] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:10.768014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.769266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.771123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 43/90] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:10.771916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.889241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ae919-d689-449d-afbf-d33fa413b834 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.891001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34ef6b-5758-45af-85c9-3162a0ed619d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:10.938898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.939673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.939976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:10.940094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.940255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.940941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:10.941225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=8ac033f9505f4cb0aca3a79776c62469) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:10.941327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:10.941508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:10.941609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.942732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:10.942987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.944192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:10.946275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 44/91] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:10.946878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.952639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 48/92] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/role_assignments?user.id=8ac033f9505f4cb0aca3a79776c62469&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:10.953665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:10.984284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:11.018120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:11.075665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90468255-176c-4874-81bd-74d64e3d0d3f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:11.096889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bbb89-2900-4a68-9b1e-2bf088fe2c30 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:11.115987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:11.116745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:11.117039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:11.117368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:11.145497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:11.148023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:11.149301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:11.149802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:11.152397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] RBAC: Adding query filter params (role.id=8888db000f97433e8f047879704f3916, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=8ac033f9505f4cb0aca3a79776c62469) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:11.153164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:11.154876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:11.169779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 45/93] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/role_assignments?user.id=8ac033f9505f4cb0aca3a79776c62469&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=8888db000f97433e8f047879704f3916 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:11.170986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:11.296218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:11.298110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:11.347873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:11.355878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c9f8-bbf9-4858-9c25-a39d73cbd8ac None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:11.374256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:11.410398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:11.411084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:11.411376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:11.411666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:11.412529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=6bb17e1228d44efb843bda521c27b495) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:11.412952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:11.414474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:11.421264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 46/94] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:11 2022] GET /identity/v3/role_assignments?user.id=6bb17e1228d44efb843bda521c27b495&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:11.476962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 49/95] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:11.482950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:11.607915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9e9dd-7ae1-4c5a-b193-e67b7416d7a0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:11.645641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3e706-33b6-4ba2-bf4d-d1405a25adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:11.646537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e706-33b6-4ba2-bf4d-d1405a25adc4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:11.646833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e706-33b6-4ba2-bf4d-d1405a25adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:11.647121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e706-33b6-4ba2-bf4d-d1405a25adc4 None admin] PATH_INFO: `/v3/projects/c758e222024d4ef88d5214f5a4e312a4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:11.648462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3e706-33b6-4ba2-bf4d-d1405a25adc4 None admin] RBAC: Authorizing `identity:get_project(project_id=c758e222024d4ef88d5214f5a4e312a4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:11.650463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3e706-33b6-4ba2-bf4d-d1405a25adc4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:11.652248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 47/96] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:11 2022] GET /identity/v3/projects/c758e222024d4ef88d5214f5a4e312a4 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:11.658433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:11.790873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccf287-5d6f-4ae0-b0aa-85c98b882946 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:11.817593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:11.830837 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a66e5a-e3d8-4a06-ba9e-e92dd564baf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:11.831511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a66e5a-e3d8-4a06-ba9e-e92dd564baf8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:11.831804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a66e5a-e3d8-4a06-ba9e-e92dd564baf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:11.832095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a66e5a-e3d8-4a06-ba9e-e92dd564baf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:11.832978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a66e5a-e3d8-4a06-ba9e-e92dd564baf8 None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=c758e222024d4ef88d5214f5a4e312a4, user.id=8ac033f9505f4cb0aca3a79776c62469) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:11.833300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a66e5a-e3d8-4a06-ba9e-e92dd564baf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:11.834773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a66e5a-e3d8-4a06-ba9e-e92dd564baf8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:11.841154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 50/97] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:11 2022] GET /identity/v3/role_assignments?user.id=8ac033f9505f4cb0aca3a79776c62469&scope.project.id=c758e222024d4ef88d5214f5a4e312a4&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:14.086663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b31f8-5570-426f-9819-8f898a481444 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.090659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b31f8-5570-426f-9819-8f898a481444 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.091353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b31f8-5570-426f-9819-8f898a481444 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.093048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 48/98] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:14.100549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014ead-1840-44db-b5aa-864a1ab5a6f7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.101537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014ead-1840-44db-b5aa-864a1ab5a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.102054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014ead-1840-44db-b5aa-864a1ab5a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.129926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ab014ead-1840-44db-b5aa-864a1ab5a6f7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:14.131563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ab014ead-1840-44db-b5aa-864a1ab5a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:14.234481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 51/99] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:14.256325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47167-c987-4c34-8b8f-c954b0f61a8d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.256983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47167-c987-4c34-8b8f-c954b0f61a8d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.257495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47167-c987-4c34-8b8f-c954b0f61a8d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.259881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 49/100] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:14.265208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f31c-590b-4584-87d9-06bb215179a8 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.265849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f31c-590b-4584-87d9-06bb215179a8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.266380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f31c-590b-4584-87d9-06bb215179a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.274131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec47167-c987-4c34-8b8f-c954b0f61a8d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:14.297405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-bf90f31c-590b-4584-87d9-06bb215179a8 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:14.299728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bf90f31c-590b-4584-87d9-06bb215179a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:14.379604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:14.393979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 52/101] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:14.424597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90f31c-590b-4584-87d9-06bb215179a8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:14.456405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec47167-c987-4c34-8b8f-c954b0f61a8d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:14.509671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:14.524406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54934-d540-4a64-909b-91cc29e2a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:14.525555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54934-d540-4a64-909b-91cc29e2a692 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.525850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54934-d540-4a64-909b-91cc29e2a692 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.526136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54934-d540-4a64-909b-91cc29e2a692 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.551607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad54934-d540-4a64-909b-91cc29e2a692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-dad54934-d540-4a64-909b-91cc29e2a692 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:14.567249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:14.568378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:14.569438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:14.571704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 50/102] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:14.573151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97bf1-f80e-4c87-b456-57a85f8000b3 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.573603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97bf1-f80e-4c87-b456-57a85f8000b3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.574038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97bf1-f80e-4c87-b456-57a85f8000b3 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.574242 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90f31c-590b-4584-87d9-06bb215179a8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:14.582663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 51/103] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:14.582663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97bf1-f80e-4c87-b456-57a85f8000b3 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:14.610408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6fc48-f08e-4625-b1c5-306fe13344d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:14.611437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6fc48-f08e-4625-b1c5-306fe13344d6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.611841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6fc48-f08e-4625-b1c5-306fe13344d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.612254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6fc48-f08e-4625-b1c5-306fe13344d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.624375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6fc48-f08e-4625-b1c5-306fe13344d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f8c6fc48-f08e-4625-b1c5-306fe13344d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:14.633094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:14.634147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:14.635121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:14.640625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 53/104] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:14.640625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbeee2-d331-4908-9ef7-3ea49c0427b9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.640625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbeee2-d331-4908-9ef7-3ea49c0427b9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.640625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbeee2-d331-4908-9ef7-3ea49c0427b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.659558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-08cbeee2-d331-4908-9ef7-3ea49c0427b9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:14.660794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-08cbeee2-d331-4908-9ef7-3ea49c0427b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:14.727664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97bf1-f80e-4c87-b456-57a85f8000b3 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:14.732296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:14.741667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 54/105] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:14.742969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d9e5-3e7f-43f8-86be-6650b1b4079c None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.743345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d9e5-3e7f-43f8-86be-6650b1b4079c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.743633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d9e5-3e7f-43f8-86be-6650b1b4079c None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.745037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 55/106] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:14.745804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d9e5-3e7f-43f8-86be-6650b1b4079c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:14.796107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e67b6-39ef-4c55-b599-f675a331fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:14.796692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:14.796876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e67b6-39ef-4c55-b599-f675a331fa13 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.797542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e67b6-39ef-4c55-b599-f675a331fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.797839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e67b6-39ef-4c55-b599-f675a331fa13 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.798605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e67b6-39ef-4c55-b599-f675a331fa13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:14.798925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e67b6-39ef-4c55-b599-f675a331fa13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:14.800526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e67b6-39ef-4c55-b599-f675a331fa13 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:14.810159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 52/107] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:14.811426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c100-4eae-482b-80b1-0b824f28fc33 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.811724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c100-4eae-482b-80b1-0b824f28fc33 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.812012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c100-4eae-482b-80b1-0b824f28fc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.829085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ad43c100-4eae-482b-80b1-0b824f28fc33 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:14.830348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ad43c100-4eae-482b-80b1-0b824f28fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:14.870208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d9e5-3e7f-43f8-86be-6650b1b4079c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:14.904177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 53/108] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:14.905069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c100-4eae-482b-80b1-0b824f28fc33 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:14.911523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:14.912284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:14.912671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:14.913030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:14.914032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:14.914933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:14.916947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:14.926746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 56/109] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:14.929569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.002642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.008944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c100-4eae-482b-80b1-0b824f28fc33 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.025535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.029393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0af15-430d-43ff-b0ea-b905f40a59dc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.043971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b95f6-4a0b-4142-916e-56268a28ed57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.044796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b95f6-4a0b-4142-916e-56268a28ed57 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.045092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b95f6-4a0b-4142-916e-56268a28ed57 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.045371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b95f6-4a0b-4142-916e-56268a28ed57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.046542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b95f6-4a0b-4142-916e-56268a28ed57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:15.048003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b95f6-4a0b-4142-916e-56268a28ed57 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:15.049657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 54/110] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:15.050898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0392-00c8-46cd-962b-c509846d167f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.051192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0392-00c8-46cd-962b-c509846d167f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.051488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0392-00c8-46cd-962b-c509846d167f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.056914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 55/111] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:15.058134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e87d-8af5-4d07-8580-a03c7776c25d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.058429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e87d-8af5-4d07-8580-a03c7776c25d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.058713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e87d-8af5-4d07-8580-a03c7776c25d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.059969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 56/112] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:15.063968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274e87d-8af5-4d07-8580-a03c7776c25d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.064313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.065220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.065516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.065799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] PATH_INFO: `/v3/users/1d7ff09f8b13484abd4aedb1c93565ae` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.080077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] RBAC: Authorizing `identity:get_user(user_id=1d7ff09f8b13484abd4aedb1c93565ae)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:15.081617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:15.083309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 57/113] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:14 2022] GET /identity/v3/users/1d7ff09f8b13484abd4aedb1c93565ae => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:15.084083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.163650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274e87d-8af5-4d07-8580-a03c7776c25d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.182568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735836-84f3-4404-9aff-00d9d79987b6 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.201306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.202124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.202481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.202830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.214233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:15.220681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88928a3c-9c69-4e42-aed6-13425365dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.221588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928a3c-9c69-4e42-aed6-13425365dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.221879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928a3c-9c69-4e42-aed6-13425365dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.222159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928a3c-9c69-4e42-aed6-13425365dcb9 None admin] PATH_INFO: `/v3/users/6bb17e1228d44efb843bda521c27b495` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:15.222380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:15.223205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:15.223953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:15.224654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88928a3c-9c69-4e42-aed6-13425365dcb9 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb17e1228d44efb843bda521c27b495)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:15.224743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 57/114] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:15.224743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.229643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88928a3c-9c69-4e42-aed6-13425365dcb9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:15.231305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 58/115] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/users/6bb17e1228d44efb843bda521c27b495 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:15.232540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d99503-ada0-4647-ae1a-5bda52010307 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.232859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d99503-ada0-4647-ae1a-5bda52010307 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.233139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d99503-ada0-4647-ae1a-5bda52010307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.249710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c6d99503-ada0-4647-ae1a-5bda52010307 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:15.250906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c6d99503-ada0-4647-ae1a-5bda52010307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:15.252368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.268702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.317837 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 59/116] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:15.319104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2b9d-31ca-4ebe-83ac-995dd3df3d4c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.319404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2b9d-31ca-4ebe-83ac-995dd3df3d4c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.319717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2b9d-31ca-4ebe-83ac-995dd3df3d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.333021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2512ae-f5d1-467b-9846-16bee6f1f323 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.348798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-217d2b9d-31ca-4ebe-83ac-995dd3df3d4c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:15.349985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-217d2b9d-31ca-4ebe-83ac-995dd3df3d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:15.367291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.367955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.368249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.368575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.369320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:15.370767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:15.396150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 58/117] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:41:15 2022] POST /identity/v3/projects => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:15.397030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.419493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 60/118] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:15.420632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2b9d-31ca-4ebe-83ac-995dd3df3d4c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.493093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.523192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6c42-6d44-4170-9f45-ed4fe0e26635 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.525158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.545417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2b9d-31ca-4ebe-83ac-995dd3df3d4c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.562383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.563080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.563371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.563653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.587503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.588192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.588487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.588826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.589591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:15.589908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:15.591353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:15.600644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 61/119] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:15.601326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.642684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:15.644308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:15.707698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862b124-da6b-4c9a-b586-80d78d865f80 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.723727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.744155 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.745161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.745521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.745885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.747160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:15.748770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:15.749683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 59/120] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:15.750464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 62/121] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:15.750878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.751238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.772096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:15.867374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964f3dd-28d5-422c-8d30-46e95a3f415f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.872939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283f3cc-9af6-4748-90c1-d45d699cf1c9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:15.904427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.905374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.905667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.905953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.908741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:15.909346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:15.909635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:15.909913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:15.917318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:15.921275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:15.925328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:15.926172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 63/122] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:15.927348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:15.930281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:15.931664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:15.933592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 60/123] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:15.936328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:15.980165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.011016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.037441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df015194-60c0-4265-a95b-21f0f1abf6c1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.052207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8145d6-c3cd-4f36-ac84-e35be6c955c1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.073825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.074708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.075002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.075282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.076482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.078003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.079790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 64/124] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.080374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.088784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.089658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.089947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.090230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.091434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.093366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.095612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 61/125] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:15 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.096518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.198544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d648e-bbc9-4941-b8c2-67025016e404 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.215891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54eb5-6fb7-42d9-b4de-d854f36dfd28 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.218531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.240480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.241328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.241615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.241896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/6bb17e1228d44efb843bda521c27b495/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.244052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] RBAC: Authorizing `identity:create_grant(project_id=50358d273b27456a83e9a62e2a34ff3a, user_id=6bb17e1228d44efb843bda521c27b495, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.245563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.252972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.253685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.253976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.254331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.255139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:16.255441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.256871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.268773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 65/126] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:16 2022] PUT /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/6bb17e1228d44efb843bda521c27b495/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:16.268773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.271562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.275354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 62/127] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.276457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.391921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049711ba-43ff-434d-8dc0-f07f907a2373 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.392249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a9ed7-3061-4c35-b548-533ffd2e541f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.430881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.431945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.432334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.433192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.434525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.435874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.436201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.436937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.437370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.437800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.438486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 63/128] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.438890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:16.439359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.441092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.444305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.454803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 66/129] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.455903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.498526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.538257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.594880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab4538-8577-4114-8c5a-4d0b19567203 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.596709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c72d7-0875-4291-8a9e-beedf60d5ce6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.630867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.631981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.632439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.633414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.634783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.636389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.638546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 67/130] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.639598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.646390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.647179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.647570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.647953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.649494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] RBAC: Adding query filter params (role.id=eb84f3c1359e4f64a2e501ff0bea36a8, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=1d7ff09f8b13484abd4aedb1c93565ae) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:16.649915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.651568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.659361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 64/131] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/role_assignments?user.id=1d7ff09f8b13484abd4aedb1c93565ae&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=eb84f3c1359e4f64a2e501ff0bea36a8 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.660720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.754235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a265-da2b-48c2-8591-6aac119831bd None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.792206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.794135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:16.800488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.801342 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896d21-c3dc-4b6f-a873-219250fdd92c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:16.801805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.802158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.802502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/8ac033f9505f4cb0aca3a79776c62469/roles/8888db000f97433e8f047879704f3916` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.812618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=50358d273b27456a83e9a62e2a34ff3a, user_id=8ac033f9505f4cb0aca3a79776c62469, role_id=8888db000f97433e8f047879704f3916)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.812618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.836903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 68/132] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:16 2022] PUT /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/8ac033f9505f4cb0aca3a79776c62469/roles/8888db000f97433e8f047879704f3916 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:16.837721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:16.879456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:16.881482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:16.882536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:16.883559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:16.885599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:16.887665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:16.889745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 65/133] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:16.899216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:17.030984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b29f72-9e12-4bcd-ad3d-b93cee643c11 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:17.059267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369adfd-faac-451f-9a7c-a21403266ff5 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:17.077150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:17.078210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:17.078596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:17.078975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:17.082487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:17.084104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:17.086114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 66/134] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:17.092696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:17.146716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:17.148807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:17.149731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:17.150019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:17.150338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] PATH_INFO: `/v3/projects/c758e222024d4ef88d5214f5a4e312a4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:17.153352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] RBAC: Authorizing `identity:get_project(project_id=c758e222024d4ef88d5214f5a4e312a4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:17.154869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:17.157944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 69/135] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:16 2022] GET /identity/v3/projects/c758e222024d4ef88d5214f5a4e312a4 => generated 312 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:17.172458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:17.247970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec901c-40dc-4be1-a13d-cccb41b45f98 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:17.287361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d448766-6e27-4aa7-9dd3-595d2c9770b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:17.288337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d448766-6e27-4aa7-9dd3-595d2c9770b8 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:17.288532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:17.289473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d448766-6e27-4aa7-9dd3-595d2c9770b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:17.289755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d448766-6e27-4aa7-9dd3-595d2c9770b8 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/8ac033f9505f4cb0aca3a79776c62469/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:17.296680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d448766-6e27-4aa7-9dd3-595d2c9770b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=50358d273b27456a83e9a62e2a34ff3a, user_id=8ac033f9505f4cb0aca3a79776c62469, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:17.296680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d448766-6e27-4aa7-9dd3-595d2c9770b8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:17.313358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 67/136] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:17 2022] PUT /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/8ac033f9505f4cb0aca3a79776c62469/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:17.369029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e4ee7-5a93-4526-8817-802a88339d35 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:17.421821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b6a5-7f3a-432b-9b6a-0156d070d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:17.422979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b6a5-7f3a-432b-9b6a-0156d070d4a4 None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:17.423415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b6a5-7f3a-432b-9b6a-0156d070d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:17.423841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b6a5-7f3a-432b-9b6a-0156d070d4a4 None admin] PATH_INFO: `/v3/projects/c758e222024d4ef88d5214f5a4e312a4/users/8ac033f9505f4cb0aca3a79776c62469/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:17.431251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9b6a5-7f3a-432b-9b6a-0156d070d4a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c758e222024d4ef88d5214f5a4e312a4, user_id=8ac033f9505f4cb0aca3a79776c62469, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:17.433064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9b6a5-7f3a-432b-9b6a-0156d070d4a4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:17.452995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 70/137] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:17 2022] PUT /identity/v3/projects/c758e222024d4ef88d5214f5a4e312a4/users/8ac033f9505f4cb0aca3a79776c62469/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:18.066570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5a691-4aa9-4164-8420-be846b7f5900 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:18.066939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5a691-4aa9-4164-8420-be846b7f5900 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:18.067145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5a691-4aa9-4164-8420-be846b7f5900 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:18.068688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 68/138] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:18.074951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001a3fd-e713-4d13-882b-0fb429206d9f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:18.075252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001a3fd-e713-4d13-882b-0fb429206d9f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:18.075544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001a3fd-e713-4d13-882b-0fb429206d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:18.097398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e001a3fd-e713-4d13-882b-0fb429206d9f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:18.098606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e001a3fd-e713-4d13-882b-0fb429206d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:18.189443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 71/139] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:18.230742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5a691-4aa9-4164-8420-be846b7f5900 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:18.342701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:18.354473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5a691-4aa9-4164-8420-be846b7f5900 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:18.400737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4040bb-3922-4198-843c-ef01f4cb6d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:18.401535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4040bb-3922-4198-843c-ef01f4cb6d09 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:18.401826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4040bb-3922-4198-843c-ef01f4cb6d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:18.402110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4040bb-3922-4198-843c-ef01f4cb6d09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:18.403303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4040bb-3922-4198-843c-ef01f4cb6d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:18.404774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4040bb-3922-4198-843c-ef01f4cb6d09 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:18.406391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 69/140] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:18.412096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001a3fd-e713-4d13-882b-0fb429206d9f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:18.485867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:18.543224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001a3fd-e713-4d13-882b-0fb429206d9f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:18.580143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b292a5-3c82-43cd-8df0-73fc78e18e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:18.580907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b292a5-3c82-43cd-8df0-73fc78e18e35 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:18.581202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b292a5-3c82-43cd-8df0-73fc78e18e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:18.581480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b292a5-3c82-43cd-8df0-73fc78e18e35 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:18.582211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b292a5-3c82-43cd-8df0-73fc78e18e35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:18.583687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b292a5-3c82-43cd-8df0-73fc78e18e35 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:18.604608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 72/141] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:41:18 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:19.303666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec3774-95a4-472d-9e1c-ff5e077676fe None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:19.303991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec3774-95a4-472d-9e1c-ff5e077676fe None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:19.304228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec3774-95a4-472d-9e1c-ff5e077676fe None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:19.305911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 70/142] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:19.311340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a21470-d2b0-429c-b076-6bd5a425339d None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:19.311638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a21470-d2b0-429c-b076-6bd5a425339d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:19.311923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a21470-d2b0-429c-b076-6bd5a425339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:19.330487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c5a21470-d2b0-429c-b076-6bd5a425339d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:19.331693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c5a21470-d2b0-429c-b076-6bd5a425339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:19.410891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 73/143] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:19.452480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec3774-95a4-472d-9e1c-ff5e077676fe None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:19.585371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec3774-95a4-472d-9e1c-ff5e077676fe None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:19.628293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:19.629240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:19.629528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:19.629840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:19.650180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:19.657944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:19.660055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:19.662045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 71/144] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:19.666280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a21470-d2b0-429c-b076-6bd5a425339d None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:19.723810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:19.814963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a21470-d2b0-429c-b076-6bd5a425339d None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:19.874462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:19.875197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:19.880623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:19.880623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:19.880623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:19.880623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:19.880623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:19.888469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 74/145] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:19.897704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:19.935736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:20.031703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3c1be-741d-4297-be99-52a5e330463d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:20.077293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:20.078193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.078475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.078752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] PATH_INFO: `/v3/users/6bb17e1228d44efb843bda521c27b495` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.080025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] RBAC: Authorizing `identity:get_user(user_id=6bb17e1228d44efb843bda521c27b495)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:20.081605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:20.083365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 72/146] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:19 2022] GET /identity/v3/users/6bb17e1228d44efb843bda521c27b495 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:20.088892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:20.206860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:20.211193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc13bba-e914-4bf6-b3ab-d826fe70943c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:20.249248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb268a9-a5ce-4811-9fc7-3d79414cfa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:20.249904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb268a9-a5ce-4811-9fc7-3d79414cfa9a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.250184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb268a9-a5ce-4811-9fc7-3d79414cfa9a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.250459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb268a9-a5ce-4811-9fc7-3d79414cfa9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.327469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb268a9-a5ce-4811-9fc7-3d79414cfa9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:20.328997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb268a9-a5ce-4811-9fc7-3d79414cfa9a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:20.428745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:20.436967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 75/147] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:20.442782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:20.466507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977e36e-b545-4254-bfe5-10b2f66f838a None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.466784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977e36e-b545-4254-bfe5-10b2f66f838a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.466972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977e36e-b545-4254-bfe5-10b2f66f838a None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.468551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 76/148] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:20.474123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c3ca-e9ca-442d-a47c-fde80dc06934 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.474408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c3ca-e9ca-442d-a47c-fde80dc06934 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.474686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118c3ca-e9ca-442d-a47c-fde80dc06934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.518876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b118c3ca-e9ca-442d-a47c-fde80dc06934 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:20.520254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b118c3ca-e9ca-442d-a47c-fde80dc06934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:20.602231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:20.626186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8a9a-1d40-48ef-8692-cd9f2afec690 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:20.683519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 77/149] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:20.702249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:20.703148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.703443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.703731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.705022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:20.707311 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c3ca-e9ca-442d-a47c-fde80dc06934 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:20.709680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:20.713092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 73/150] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:20 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:20.721860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:20.858851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118c3ca-e9ca-442d-a47c-fde80dc06934 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:20.889324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:20.906854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623705d-ba5e-4db1-a5fd-013404e967e4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:20.913308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a6b49-8169-474d-bf3f-98be2d176a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:20.914709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a6b49-8169-474d-bf3f-98be2d176a20 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.914997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a6b49-8169-474d-bf3f-98be2d176a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.915285 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a6b49-8169-474d-bf3f-98be2d176a20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.958850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a6b49-8169-474d-bf3f-98be2d176a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:20.963508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4278e33-2bf8-4251-879b-acf00795cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:20.964389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4278e33-2bf8-4251-879b-acf00795cb37 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.964904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4278e33-2bf8-4251-879b-acf00795cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.965364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4278e33-2bf8-4251-879b-acf00795cb37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.966408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4278e33-2bf8-4251-879b-acf00795cb37 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=6bb17e1228d44efb843bda521c27b495) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:20.966928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4278e33-2bf8-4251-879b-acf00795cb37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-eb4a6b49-8169-474d-bf3f-98be2d176a20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:20.967667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:20.968877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:20.969641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:20.970229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4278e33-2bf8-4251-879b-acf00795cb37 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:20.970296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 78/151] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:20.973246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ca64e-a026-4857-9366-e60400c421a6 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.973492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ca64e-a026-4857-9366-e60400c421a6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.973747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ca64e-a026-4857-9366-e60400c421a6 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.975052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 74/152] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:20 2022] GET /identity/v3/role_assignments?user.id=6bb17e1228d44efb843bda521c27b495&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:20.975204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 79/153] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:20.981847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad825e1-3de2-4159-af22-11fa638ee408 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:20.982223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad825e1-3de2-4159-af22-11fa638ee408 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:20.982578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad825e1-3de2-4159-af22-11fa638ee408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:20.989619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ca64e-a026-4857-9366-e60400c421a6 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:21.002804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8ad825e1-3de2-4159-af22-11fa638ee408 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:21.004173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8ad825e1-3de2-4159-af22-11fa638ee408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:21.049009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:21.134968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 75/154] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:21.136363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623334cd-ab5a-4edd-8d6c-5606ac0de9cd None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.136644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623334cd-ab5a-4edd-8d6c-5606ac0de9cd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.136928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623334cd-ab5a-4edd-8d6c-5606ac0de9cd None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.138340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 76/155] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:21.143541 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7977f0-d035-48b7-8a97-35ec2f30a49b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.143831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7977f0-d035-48b7-8a97-35ec2f30a49b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.144110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7977f0-d035-48b7-8a97-35ec2f30a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.185036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5f7977f0-d035-48b7-8a97-35ec2f30a49b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:21.186243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5f7977f0-d035-48b7-8a97-35ec2f30a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:21.262451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ca64e-a026-4857-9366-e60400c421a6 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:21.362352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c20a-ac33-4919-945a-3276d3f0bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:21.363051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c20a-ac33-4919-945a-3276d3f0bb56 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.363344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c20a-ac33-4919-945a-3276d3f0bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.363628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c20a-ac33-4919-945a-3276d3f0bb56 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.364402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201c20a-ac33-4919-945a-3276d3f0bb56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:21.364744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201c20a-ac33-4919-945a-3276d3f0bb56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:21.366337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201c20a-ac33-4919-945a-3276d3f0bb56 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:21.372640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 77/156] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:21.373947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7977f0-d035-48b7-8a97-35ec2f30a49b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:21.383734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 80/157] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:21.385249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0158c2-2d98-48ff-9700-6ee52cac608c None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.385669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0158c2-2d98-48ff-9700-6ee52cac608c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.386079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0158c2-2d98-48ff-9700-6ee52cac608c None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.388006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 81/158] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:21.401546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da4c6e-35c7-4b28-ab68-df4d5552d8d5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.402043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da4c6e-35c7-4b28-ab68-df4d5552d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.402374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da4c6e-35c7-4b28-ab68-df4d5552d8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.447627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-71da4c6e-35c7-4b28-ab68-df4d5552d8d5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:21.448865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-71da4c6e-35c7-4b28-ab68-df4d5552d8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:21.514668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:21.540495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:21.551194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7977f0-d035-48b7-8a97-35ec2f30a49b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:21.592136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:21.593123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.593411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.593929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.599105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 82/159] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:21.599972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da4c6e-35c7-4b28-ab68-df4d5552d8d5 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:21.623265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:21.637197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:21.638167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:21.638982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 78/160] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:21.639617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:21.754639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187fa1-5405-4b60-a9ee-57937f344330 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:21.760683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da4c6e-35c7-4b28-ab68-df4d5552d8d5 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:21.793430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:21.794156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.794643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.794764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.799831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:21.801088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.801644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.802110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] PATH_INFO: `/v3/users/1d7ff09f8b13484abd4aedb1c93565ae` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.803508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] RBAC: Authorizing `identity:get_user(user_id=1d7ff09f8b13484abd4aedb1c93565ae)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:21.805252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:21.806165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:21.807315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 83/161] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:21 2022] GET /identity/v3/users/1d7ff09f8b13484abd4aedb1c93565ae => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:21.808274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:21.814297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:21.815269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:21.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 79/162] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:21.816785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:21.820944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:21.866559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:21.921704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bdab7-d3af-49c5-bc6e-cb3cf7f8b460 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:21.927820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bfe60-86bc-4e29-84a5-a116dacd2f15 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:21.958773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:21.959825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.960300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.961345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.962288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:21.962825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:21.964758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:21.966592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:21.967400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:21.967688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:21.967974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:21.975051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 84/163] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:21.976167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:21.979023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:21.987133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:21.988255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 80/164] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:21.993493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.058289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:22.090895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d45b-4e05-4d9e-8023-922da44c646b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:22.101177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c7ed-4b32-4c74-86e0-22f3ee9cccac None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:22.102158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:22.137227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:22.138541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:22.139147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:22.139614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:22.139715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:22.141641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:22.141641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:22.141641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:22.142175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:22.142585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:22.142939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:22.144332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:22.144731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:22.146901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 85/165] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:21 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:22.155900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.156048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 81/166] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:22.156048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.344078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa4f3c-db17-4dfc-920f-4ebce7cf4ce3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:22.350702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098eb30-34b0-4561-a5bc-93fe66f9c2eb None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:22.369451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:22.382361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:22.383584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:22.383876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:22.384157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:22.384950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:22.385269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:22.386786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:22.395765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 82/167] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:22.396626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.451629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:22.452532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:22.452853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:22.453137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:22.454384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:22.455859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:22.457814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 86/168] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:22 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:22.458592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.528767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815253-2708-4ac1-b1a4-ba59de1e58d9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:22.548810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:22.593928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:22.594888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:22.595121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:22.595403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/1d7ff09f8b13484abd4aedb1c93565ae/roles/eb84f3c1359e4f64a2e501ff0bea36a8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:22.598548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] RBAC: Authorizing `identity:create_grant(project_id=50358d273b27456a83e9a62e2a34ff3a, user_id=1d7ff09f8b13484abd4aedb1c93565ae, role_id=eb84f3c1359e4f64a2e501ff0bea36a8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:22.600015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:22.625161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 83/169] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:22 2022] PUT /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a/users/1d7ff09f8b13484abd4aedb1c93565ae/roles/eb84f3c1359e4f64a2e501ff0bea36a8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:22.626308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.655253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061dac6-56d5-44ab-8a99-7053a628b86f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:22.725298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:22.737395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:22.738324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:22.738614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:22.738898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:22.741432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:22.743924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:22.749553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 87/170] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:22 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:22.752036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.814053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb9a8b-a53e-4c88-8395-ce18d4a2e3cb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:22.852213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:22.853599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:22.854119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:22.854640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] PATH_INFO: `/v3/users/8ac033f9505f4cb0aca3a79776c62469` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:22.856140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac033f9505f4cb0aca3a79776c62469)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:22.857845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:22.859893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 84/171] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:22 2022] GET /identity/v3/users/8ac033f9505f4cb0aca3a79776c62469 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:22.865506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:22.994242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39845-ba57-4391-b16c-97db159c2a07 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:23.012975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:23.049311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85075c86-7974-4523-85d3-06c4a573cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:23.050138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075c86-7974-4523-85d3-06c4a573cf1e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.050518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075c86-7974-4523-85d3-06c4a573cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.050869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075c86-7974-4523-85d3-06c4a573cf1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.053891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df2cba-c139-4484-8455-ac6a5790f9bc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:23.071244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:23.099415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:23.100447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.101267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.101747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.189789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:23.191722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:23.211678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85075c86-7974-4523-85d3-06c4a573cf1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:23.211678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85075c86-7974-4523-85d3-06c4a573cf1e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:23.319199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 88/172] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:23.320453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:23.337156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:23.408999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 85/173] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:23.410697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369227ca-8974-4c0a-9232-f47d33b2b727 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.411164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369227ca-8974-4c0a-9232-f47d33b2b727 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.411590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369227ca-8974-4c0a-9232-f47d33b2b727 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.418115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 86/174] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:23.419216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369227ca-8974-4c0a-9232-f47d33b2b727 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:23.436345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:23.453822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bbd39-a079-4c04-abfd-fca560fe952e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:23.502021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c740f-badd-4d39-b9bf-2f2ca0e6f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:23.502693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c740f-badd-4d39-b9bf-2f2ca0e6f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.502983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c740f-badd-4d39-b9bf-2f2ca0e6f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.503266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c740f-badd-4d39-b9bf-2f2ca0e6f4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.532052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369227ca-8974-4c0a-9232-f47d33b2b727 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:23.572145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a846ae-b629-4dc6-84ab-ad49e4717314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:23.573034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a846ae-b629-4dc6-84ab-ad49e4717314 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.573320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a846ae-b629-4dc6-84ab-ad49e4717314 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.573595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a846ae-b629-4dc6-84ab-ad49e4717314 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.574790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a846ae-b629-4dc6-84ab-ad49e4717314 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:23.576266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a846ae-b629-4dc6-84ab-ad49e4717314 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:23.577700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c740f-badd-4d39-b9bf-2f2ca0e6f4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:23.578190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 87/175] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:23 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:23.579200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c740f-badd-4d39-b9bf-2f2ca0e6f4c1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:23.579381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7645f-74b7-418d-b87a-d4eced2ff824 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.579632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7645f-74b7-418d-b87a-d4eced2ff824 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.579918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7645f-74b7-418d-b87a-d4eced2ff824 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.584937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 88/176] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:23.584937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7645f-74b7-418d-b87a-d4eced2ff824 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:23.597611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:23.674863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:23.691452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 89/177] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:23.693124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10a4f-cdc7-465e-ba68-d6c689285cba None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.693622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10a4f-cdc7-465e-ba68-d6c689285cba None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.694103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10a4f-cdc7-465e-ba68-d6c689285cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.695875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7645f-74b7-418d-b87a-d4eced2ff824 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:23.711589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-62c10a4f-cdc7-465e-ba68-d6c689285cba None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:23.712860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-62c10a4f-cdc7-465e-ba68-d6c689285cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:23.733299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7271e-7959-4194-8361-389a2de910c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:23.734163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7271e-7959-4194-8361-389a2de910c5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.734463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7271e-7959-4194-8361-389a2de910c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.734739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7271e-7959-4194-8361-389a2de910c5 None admin] PATH_INFO: `/v3/projects/c758e222024d4ef88d5214f5a4e312a4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.735955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7271e-7959-4194-8361-389a2de910c5 None admin] RBAC: Authorizing `identity:get_project(project_id=c758e222024d4ef88d5214f5a4e312a4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:23.737447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7271e-7959-4194-8361-389a2de910c5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:23.739153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 89/178] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:23 2022] GET /identity/v3/projects/c758e222024d4ef88d5214f5a4e312a4 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:23.740572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d07e-c233-4f51-8066-10b7cb580fe8 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.740883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d07e-c233-4f51-8066-10b7cb580fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.741168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649d07e-c233-4f51-8066-10b7cb580fe8 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.742442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 90/179] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:23.743212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d07e-c233-4f51-8066-10b7cb580fe8 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:23.796967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 90/180] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:23.798599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6ca5-5f4c-4fb0-9b84-0b4361429e56 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.799097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6ca5-5f4c-4fb0-9b84-0b4361429e56 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.799578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6ca5-5f4c-4fb0-9b84-0b4361429e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.817429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-15df6ca5-5f4c-4fb0-9b84-0b4361429e56 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:23.819084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-15df6ca5-5f4c-4fb0-9b84-0b4361429e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:23.861876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:23.867302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649d07e-c233-4f51-8066-10b7cb580fe8 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:23.896603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 91/181] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:23.896603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6ca5-5f4c-4fb0-9b84-0b4361429e56 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:23.914864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:23.915904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:23.916192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:23.916476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:23.917803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] RBAC: Adding query filter params (role.id=8888db000f97433e8f047879704f3916, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=8ac033f9505f4cb0aca3a79776c62469) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:23.918470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:23.920372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:23.936610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 91/182] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:23 2022] GET /identity/v3/role_assignments?user.id=8ac033f9505f4cb0aca3a79776c62469&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=8888db000f97433e8f047879704f3916 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:23.936610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:23.957387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:24.015955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6ca5-5f4c-4fb0-9b84-0b4361429e56 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.057272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2280260-c898-4541-832b-22ab63f29dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.058149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280260-c898-4541-832b-22ab63f29dbf None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.058435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280260-c898-4541-832b-22ab63f29dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.058715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280260-c898-4541-832b-22ab63f29dbf None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.059980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2280260-c898-4541-832b-22ab63f29dbf None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.061547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2280260-c898-4541-832b-22ab63f29dbf None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.063624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 92/183] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:23 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:24.064981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0835a-3de1-46a8-9a65-6b651f957fd0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.065275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0835a-3de1-46a8-9a65-6b651f957fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.065555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0835a-3de1-46a8-9a65-6b651f957fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.087144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb476-e4b6-490f-b089-252700fc3437 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.092934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f6d0835a-3de1-46a8-9a65-6b651f957fd0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:24.094990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f6d0835a-3de1-46a8-9a65-6b651f957fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:24.133379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.134261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.134689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.135104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.136731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=c758e222024d4ef88d5214f5a4e312a4, user.id=8ac033f9505f4cb0aca3a79776c62469) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:24.136918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.139770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.147408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:24.156924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 92/184] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:23 2022] GET /identity/v3/role_assignments?user.id=8ac033f9505f4cb0aca3a79776c62469&scope.project.id=c758e222024d4ef88d5214f5a4e312a4&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:24.158058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.188794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 93/185] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:24.189946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0835a-3de1-46a8-9a65-6b651f957fd0 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.262041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:24.287536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6ab0d-2b28-43a0-9154-2fac03d8c84e None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.327292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.328285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.328571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.328876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.337363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0835a-3de1-46a8-9a65-6b651f957fd0 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.344377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:24.354920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:24.355890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:24.356763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 93/186] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:24.357418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.384108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.385398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.385882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.386335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.400750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:24.409190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:24.410178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:24.410963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 94/187] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:24.411621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.457387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:24.503085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b31c5-6c3e-45c9-8dae-2121c0e45d8a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.541870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.542701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.543003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.543295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.544137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=8ac033f9505f4cb0aca3a79776c62469) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:24.544648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.546272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.552033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa81498-9b73-402a-9f21-96e2254f9326 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.560660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 94/188] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/role_assignments?user.id=8ac033f9505f4cb0aca3a79776c62469&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:24.560660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.560660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:24.603554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.604494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.604874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.605366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.606902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.609303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.611633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 95/189] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:24.612709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.687950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc67734-484b-453e-899f-2d3af175d9f7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.728244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.729408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.729878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.730339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.731284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:24.731775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.733540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.744274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:24.744844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 95/190] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:24.746431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.747708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8713f60-b159-46af-b36d-ad92da2cacd2 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.794456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.795062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.795355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.795636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.796395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:24.796759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.798174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.807618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 96/191] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:24.808230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.825355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:24.880247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06af26-ac36-465e-91da-545d37c24eb8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.919638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.920328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.920619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.920908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.921620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.923057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.925788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8087840-559a-4744-98c4-1405ac00840d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:24.944605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 96/192] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:41:24 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:24.953672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:24.969869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:24.971606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:24.972102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:24.972620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] PATH_INFO: `/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:24.993874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:24.995959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:24.999220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 97/193] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:25.004731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:25.034928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:25.101848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd04521-e067-4e4e-a35d-09b9358e29c1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:25.127966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:25.141698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b7c6-44e5-482d-910d-2f6030b33ef6 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:25.155677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:25.157061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.157396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.157690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] PATH_INFO: `/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.159076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:25.160778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:25.164455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 97/194] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:24 2022] GET /identity/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:25.170490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:25.191460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1ffea-0c7f-4c1d-b6ad-31ddbe849401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:25.195075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ffea-0c7f-4c1d-b6ad-31ddbe849401 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.195075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ffea-0c7f-4c1d-b6ad-31ddbe849401 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.195075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1ffea-0c7f-4c1d-b6ad-31ddbe849401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.281798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1ffea-0c7f-4c1d-b6ad-31ddbe849401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:25.283653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1ffea-0c7f-4c1d-b6ad-31ddbe849401 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:25.307319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:25.312623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcce7-7d1e-47f3-98f2-930f9a194e20 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:25.367411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb2ca-ff04-4acd-92d1-e7fc59f4798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:25.367998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb2ca-ff04-4acd-92d1-e7fc59f4798a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.368293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb2ca-ff04-4acd-92d1-e7fc59f4798a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.368573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb2ca-ff04-4acd-92d1-e7fc59f4798a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.405017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 98/195] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:25.406361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be10dc-959d-41ad-894e-dc5459aaaf52 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.406649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be10dc-959d-41ad-894e-dc5459aaaf52 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.406931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be10dc-959d-41ad-894e-dc5459aaaf52 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.408260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 99/196] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:25.414510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be10dc-959d-41ad-894e-dc5459aaaf52 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:25.435745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:25.452247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfb2ca-ff04-4acd-92d1-e7fc59f4798a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:25.454258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfb2ca-ff04-4acd-92d1-e7fc59f4798a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:25.531925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be10dc-959d-41ad-894e-dc5459aaaf52 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:25.555261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:25.565156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 98/197] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 14:41:25.566372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f105e8-5b37-4166-ba71-5963e103dd99 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.566665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f105e8-5b37-4166-ba71-5963e103dd99 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.566947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f105e8-5b37-4166-ba71-5963e103dd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.574010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:25.575068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.575487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.575901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.577237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:25.579037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:25.581152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 100/198] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:25.582036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:25.594964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-50f105e8-5b37-4166-ba71-5963e103dd99 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:25.596147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-50f105e8-5b37-4166-ba71-5963e103dd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:25.670883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 99/199] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:25.670883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f105e8-5b37-4166-ba71-5963e103dd99 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:25.691302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49aa51-1212-4c5c-b6b1-aa168a9aeba8 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:25.697577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:25.728459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:25.729716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.730217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.730684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.732076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:25.733816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:25.736484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 101/200] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:25.737465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:25.777198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f105e8-5b37-4166-ba71-5963e103dd99 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:25.804987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:25.819028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:25.820510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.821032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.821539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.822632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:25.823535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:25.825671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:25.832944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 100/201] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/role_assignments?user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:25.833953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:25.875012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c96a48-878f-4a9b-95d0-631608caffb1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:25.946574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:25.947902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:25.948451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:25.948939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:25.962044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:25.970753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:25.971742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:25.972516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:25.974949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 102/202] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:25.983055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:26.000773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:26.036205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fffda-008f-44cc-b4f0-8c7b5b1d53b4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:26.081605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:26.083291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:26.084034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:26.084506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:26.086206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] RBAC: Adding query filter params (role.id=8888db000f97433e8f047879704f3916, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:26.086992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:26.089321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:26.097084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 101/203] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/role_assignments?user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=8888db000f97433e8f047879704f3916 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:26.148868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4678692-e391-428b-a7e0-0a17c10799fd None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:26.166931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:26.188453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:26.189168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:26.189452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:26.189740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:26.190496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:26.190806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:26.192423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:26.204463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 103/204] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:26.210091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:26.346533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061fb8c-4e07-439e-8429-09500a78d438 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:26.387521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:26.388427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:26.388756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:26.389037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] PATH_INFO: `/v3/users/1d7ff09f8b13484abd4aedb1c93565ae` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:26.390318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] RBAC: Authorizing `identity:get_user(user_id=1d7ff09f8b13484abd4aedb1c93565ae)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:26.391811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:26.393779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 102/205] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:26 2022] GET /identity/v3/users/1d7ff09f8b13484abd4aedb1c93565ae => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:26.399297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:26.524557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7cc57-ee7c-4ef6-881f-bf334b73f981 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:26.570739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:26.571414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:26.571700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:26.571980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:26.630611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:26.659939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:26.661464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:26.793668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 104/206] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:26.801662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:26.829659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:26.943693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb658b-cfbc-4a6b-96e4-288c402dd65b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:26.981382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2216e-fa62-417b-a624-f60f599303b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:26.982256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2216e-fa62-417b-a624-f60f599303b3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:26.982539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2216e-fa62-417b-a624-f60f599303b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:26.982817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2216e-fa62-417b-a624-f60f599303b3 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:26.984023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2216e-fa62-417b-a624-f60f599303b3 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:26.985521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2216e-fa62-417b-a624-f60f599303b3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:26.987537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 103/207] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:26 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:26.993270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:27.098189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:27.126227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884e90-ce11-4376-b9f0-60722c866dbb None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:27.171153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffe6cc-4fdb-427b-b7b9-957cdca72c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:27.171916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffe6cc-4fdb-427b-b7b9-957cdca72c17 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:27.172098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffe6cc-4fdb-427b-b7b9-957cdca72c17 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:27.172378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffe6cc-4fdb-427b-b7b9-957cdca72c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:27.173302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffe6cc-4fdb-427b-b7b9-957cdca72c17 None admin] RBAC: Adding query filter params (role.id=eb84f3c1359e4f64a2e501ff0bea36a8, scope.project.id=50358d273b27456a83e9a62e2a34ff3a, user.id=1d7ff09f8b13484abd4aedb1c93565ae) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:27.173622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffe6cc-4fdb-427b-b7b9-957cdca72c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:27.175099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffe6cc-4fdb-427b-b7b9-957cdca72c17 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:27.185402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 105/208] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:26 2022] GET /identity/v3/role_assignments?user.id=1d7ff09f8b13484abd4aedb1c93565ae&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=eb84f3c1359e4f64a2e501ff0bea36a8 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:27.654687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982bdd-fb52-4d41-ad09-60cb3417e4e5 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:27.654972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982bdd-fb52-4d41-ad09-60cb3417e4e5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:27.655502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9982bdd-fb52-4d41-ad09-60cb3417e4e5 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:27.657406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 104/209] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:27.663061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6af40-e6d1-4d3f-9103-bbb62130311f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:27.663602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6af40-e6d1-4d3f-9103-bbb62130311f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:27.664108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6af40-e6d1-4d3f-9103-bbb62130311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:27.682108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-fed6af40-e6d1-4d3f-9103-bbb62130311f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:27.683591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-fed6af40-e6d1-4d3f-9103-bbb62130311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:27.748935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80151e-f10d-4f3b-a2fe-7f0e6946c9ea None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:27.749541 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80151e-f10d-4f3b-a2fe-7f0e6946c9ea None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:27.750041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80151e-f10d-4f3b-a2fe-7f0e6946c9ea None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:27.751607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 105/210] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:27.756395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 106/211] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:27.758460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401be5c-b917-4f50-a970-648ed0e8ab3d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:27.758958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401be5c-b917-4f50-a970-648ed0e8ab3d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:27.759454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401be5c-b917-4f50-a970-648ed0e8ab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:27.778394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4401be5c-b917-4f50-a970-648ed0e8ab3d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:27.779929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4401be5c-b917-4f50-a970-648ed0e8ab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:27.781119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6af40-e6d1-4d3f-9103-bbb62130311f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:27.873985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:27.874192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 106/212] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:27.903169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401be5c-b917-4f50-a970-648ed0e8ab3d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:27.908676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6af40-e6d1-4d3f-9103-bbb62130311f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:27.918633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:27.956185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:27.957897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:27.958398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:27.958876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:27.960293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:27.962657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:27.965493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 107/213] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:27.973477 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:28.014738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401be5c-b917-4f50-a970-648ed0e8ab3d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:28.055590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:28.056393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.056707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.056990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.068605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:28.077195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:28.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:28.078923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 107/214] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:28.086488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:28.108288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e3f01-eb82-4dcb-be8f-5beee57ab402 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:28.157486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:28.158849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.159604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.160848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.161307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:28.161500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:28.165777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:28.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:28.199676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 108/215] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:41:27 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:28.218958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafde1c7-333a-4912-8916-7068f9aece00 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:28.260567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:28.261547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.261976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.262399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.263308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:28.263873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:28.265463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:28.275723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 108/216] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:28.281929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:28.399199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e230a-83f0-4163-94c6-29d8ac11e4b3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:28.436509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf8f4-1dc7-40e8-b54d-80dbbb6ebc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:28.437798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf8f4-1dc7-40e8-b54d-80dbbb6ebc79 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.438229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf8f4-1dc7-40e8-b54d-80dbbb6ebc79 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.438649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf8f4-1dc7-40e8-b54d-80dbbb6ebc79 None admin] PATH_INFO: `/v3/users/79c8cc6891f840d78c7ffb5e8943e936` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.456246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf8f4-1dc7-40e8-b54d-80dbbb6ebc79 None admin] RBAC: Authorizing `identity:get_user(user_id=79c8cc6891f840d78c7ffb5e8943e936)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:28.458091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bf8f4-1dc7-40e8-b54d-80dbbb6ebc79 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:28.460082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 109/217] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:28 2022] GET /identity/v3/users/79c8cc6891f840d78c7ffb5e8943e936 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:28.466009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:28.584413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a44a-3a7c-414d-845d-679e4350ec24 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:28.620658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:28.621577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.622009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.622444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.625261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:28.643858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa84c-68be-42a1-a884-13b3885cac3b None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.644201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa84c-68be-42a1-a884-13b3885cac3b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.644430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa84c-68be-42a1-a884-13b3885cac3b None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.645974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 110/218] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:28.651503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937613-6f12-466c-a388-400ebcac50f2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.651792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937613-6f12-466c-a388-400ebcac50f2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04937613-6f12-466c-a388-400ebcac50f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.675657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-04937613-6f12-466c-a388-400ebcac50f2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:28.676961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-04937613-6f12-466c-a388-400ebcac50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:28.708972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:28.711597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:28.746249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:28.769557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 111/219] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:28.801012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937613-6f12-466c-a388-400ebcac50f2 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:28.846605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 109/220] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:28.852662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:28.888450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:28.909466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04937613-6f12-466c-a388-400ebcac50f2 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:28.946411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa87106-81bc-4794-bcca-dda5b413bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:28.947315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87106-81bc-4794-bcca-dda5b413bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.947642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87106-81bc-4794-bcca-dda5b413bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.947888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa87106-81bc-4794-bcca-dda5b413bfa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.959150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa87106-81bc-4794-bcca-dda5b413bfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:28.967049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66b79c-9596-4c6e-94fc-253f0fc98fc6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-8fa87106-81bc-4794-bcca-dda5b413bfa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:28.967564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:28.968503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:28.969397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 112/221] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:28.972369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e9f11-a087-4603-aec5-6e37665d6706 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:28.972699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e9f11-a087-4603-aec5-6e37665d6706 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:28.972984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e9f11-a087-4603-aec5-6e37665d6706 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:28.974393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 113/222] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:28.979237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e9f11-a087-4603-aec5-6e37665d6706 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.014495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806450b-1d27-4d39-8f4c-0428d1c24d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.015761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806450b-1d27-4d39-8f4c-0428d1c24d35 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.016242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806450b-1d27-4d39-8f4c-0428d1c24d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.016688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806450b-1d27-4d39-8f4c-0428d1c24d35 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.018044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806450b-1d27-4d39-8f4c-0428d1c24d35 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:29.019663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806450b-1d27-4d39-8f4c-0428d1c24d35 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:29.021681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 110/223] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:28 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:29.023547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137084e-f97e-4fb5-a573-3e106a5dabca None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.024077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137084e-f97e-4fb5-a573-3e106a5dabca None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.024531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137084e-f97e-4fb5-a573-3e106a5dabca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.027967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:29.046909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a137084e-f97e-4fb5-a573-3e106a5dabca None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:29.048197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a137084e-f97e-4fb5-a573-3e106a5dabca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:29.088518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e9f11-a087-4603-aec5-6e37665d6706 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:29.118162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 111/224] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:29.119224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137084e-f97e-4fb5-a573-3e106a5dabca None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.136609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.137431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.137768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.138053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.138813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:29.139183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:29.144814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:29.159438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 114/225] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:29.163058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.166475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:29.241587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137084e-f97e-4fb5-a573-3e106a5dabca None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:29.270785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bf157-1754-4e1f-8253-29d85e6211d1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:29.279305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:29.287514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.289460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.290156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.290577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.291799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=79c8cc6891f840d78c7ffb5e8943e936) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:29.292922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:29.294422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:29.301332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 112/226] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:29 2022] GET /identity/v3/role_assignments?user.id=79c8cc6891f840d78c7ffb5e8943e936&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:29.303011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.314384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.315864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.316173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.316455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.328923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:29.344099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:29.345108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 115/227] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:29.345885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.488112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:29.499932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0d2c-983b-4f96-82a1-a9564269fb16 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:29.517955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84d5d-42fa-4ebe-b98f-02d78045b97f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:29.575305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.576201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.576483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.576787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] PATH_INFO: `/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.578510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:29.579969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:29.582576 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 113/228] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:29 2022] GET /identity/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:29.586495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.587174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.587458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.587738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.588563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:29.589556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.590107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:29.591517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:29.602492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 116/229] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:29.607975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.678681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:29.746350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4b3b5-ffda-44f0-9ca2-7b1bfeba22a6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:29.818540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.821483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.822219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.823880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.826232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:29.830664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9282ba-8f7a-4999-bce7-a91e26585511 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:29.831417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:29.833421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 114/230] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:29 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:29.841862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.881699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:29.883624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:29.884113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:29.884625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] PATH_INFO: `/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:29.886082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] RBAC: Authorizing `identity:get_user(user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:29.887936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:29.889922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 117/231] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:29 2022] GET /identity/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:29.896058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:29.905079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:30.055108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf88b82-cfad-4819-aea0-75221a155e7a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:30.093232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:30.103323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46f4b-08ab-4632-9fe9-e80c2850e89e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:30.131712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92671-95ce-4872-8ffe-4e602205b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:30.134424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92671-95ce-4872-8ffe-4e602205b906 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:30.135829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92671-95ce-4872-8ffe-4e602205b906 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:30.136330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92671-95ce-4872-8ffe-4e602205b906 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/3a2ce7a3bd384f0eab04fd9f42ddfb58/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:30.141108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f92671-95ce-4872-8ffe-4e602205b906 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3747467244a2087fc57f41a3d33b6, user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:30.143661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f92671-95ce-4872-8ffe-4e602205b906 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:30.156085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:30.157488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:30.158014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:30.158525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:30.159985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:30.161851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:30.164901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 118/232] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:29 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:30.174090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 115/233] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:29 2022] PUT /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/3a2ce7a3bd384f0eab04fd9f42ddfb58/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:30.175499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:30.315547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d716c2-1cc3-4c47-9fbc-bd134499b0d4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:30.354120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736e240-9e4e-4b02-b423-e832e4a4c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:30.355038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736e240-9e4e-4b02-b423-e832e4a4c3ca None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:30.355327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736e240-9e4e-4b02-b423-e832e4a4c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:30.355614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736e240-9e4e-4b02-b423-e832e4a4c3ca None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/3a2ce7a3bd384f0eab04fd9f42ddfb58/roles/8888db000f97433e8f047879704f3916` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:30.357927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736e240-9e4e-4b02-b423-e832e4a4c3ca None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3747467244a2087fc57f41a3d33b6, user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58, role_id=8888db000f97433e8f047879704f3916)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:30.359434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736e240-9e4e-4b02-b423-e832e4a4c3ca None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:30.375077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 119/234] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:30 2022] PUT /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/3a2ce7a3bd384f0eab04fd9f42ddfb58/roles/8888db000f97433e8f047879704f3916 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:30.887473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532d78-3a29-44a4-a2f7-4fffc1e9d2f2 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:30.887799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532d78-3a29-44a4-a2f7-4fffc1e9d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:30.888051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532d78-3a29-44a4-a2f7-4fffc1e9d2f2 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:30.889528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 116/235] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:30.894961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ea20c-9c1c-44eb-912d-c3d125346832 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:30.895262 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ea20c-9c1c-44eb-912d-c3d125346832 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:30.895548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ea20c-9c1c-44eb-912d-c3d125346832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:30.913310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5a1ea20c-9c1c-44eb-912d-c3d125346832 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:30.914638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5a1ea20c-9c1c-44eb-912d-c3d125346832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:30.942006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:31.008863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 120/236] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:31.037400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b532d78-3a29-44a4-a2f7-4fffc1e9d2f2 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:31.153064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:31.159702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b532d78-3a29-44a4-a2f7-4fffc1e9d2f2 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:31.212283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648438-c476-494c-9672-6be2d69fd602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:31.212477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648438-c476-494c-9672-6be2d69fd602 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:31.212810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648438-c476-494c-9672-6be2d69fd602 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:31.213052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648438-c476-494c-9672-6be2d69fd602 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:31.228807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d648438-c476-494c-9672-6be2d69fd602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-8d648438-c476-494c-9672-6be2d69fd602 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:31.236804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:31.237682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:31.238475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 117/237] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:31.244228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ea20c-9c1c-44eb-912d-c3d125346832 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:31.264101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f348c-a28e-41ed-b555-ed9db14f6895 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:31.264420 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f348c-a28e-41ed-b555-ed9db14f6895 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:31.264702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f348c-a28e-41ed-b555-ed9db14f6895 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:31.266206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 118/238] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:31.274044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f407-6be2-4b31-a6fe-2f3b92dbefa3 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:31.274336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f407-6be2-4b31-a6fe-2f3b92dbefa3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:31.274622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f407-6be2-4b31-a6fe-2f3b92dbefa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:31.308238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c9d9f407-6be2-4b31-a6fe-2f3b92dbefa3 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:31.308616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c9d9f407-6be2-4b31-a6fe-2f3b92dbefa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:31.428529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 119/239] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:31.455633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ea20c-9c1c-44eb-912d-c3d125346832 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:31.479273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f407-6be2-4b31-a6fe-2f3b92dbefa3 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:31.522544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:31.523785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:31.524072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:31.524348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:31.525148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:31.525461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:31.526891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:31.536177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 121/240] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:31.546089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:31.566818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:31.652959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:31.697667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f407-6be2-4b31-a6fe-2f3b92dbefa3 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:31.713865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e94882-ae6f-4252-b4a8-db56500748cf None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:31.761613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:31.762438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:31.762780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:31.763060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:31.765291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:31.766807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:31.768769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 120/241] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:31.776553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:31.777519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:31.777693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:31.777787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:31.778175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] PATH_INFO: `/v3/users/f0e3b163051740fd8b87a93cf1b75272` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:31.795955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e3b163051740fd8b87a93cf1b75272)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:31.797522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:31.799484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 122/242] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:31 2022] GET /identity/v3/users/f0e3b163051740fd8b87a93cf1b75272 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:31.804833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:31.892956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:31.911524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1251-7729-44ba-8e15-1e7d43cc0fd4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:31.954109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:31.955189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:31.956929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:31.957500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:31.995645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699936-78fc-4b96-82a7-3c223a32ceed None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:32.034159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29e585-cd6b-4a37-a67a-ca5d150e46b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:32.035073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29e585-cd6b-4a37-a67a-ca5d150e46b0 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.035506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29e585-cd6b-4a37-a67a-ca5d150e46b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.035958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29e585-cd6b-4a37-a67a-ca5d150e46b0 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.037024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29e585-cd6b-4a37-a67a-ca5d150e46b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:32.038667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29e585-cd6b-4a37-a67a-ca5d150e46b0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:32.039187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:32.040415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:32.065257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 121/243] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:41:31 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:32.067591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71610444-dedc-47d6-ac30-6f4b5cf84321 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.068036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71610444-dedc-47d6-ac30-6f4b5cf84321 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.068522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71610444-dedc-47d6-ac30-6f4b5cf84321 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.070649 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 122/244] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:32.077478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375961f-f610-4432-85ad-661095d226ec None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.077970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375961f-f610-4432-85ad-661095d226ec None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.078455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375961f-f610-4432-85ad-661095d226ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.094154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:32.104053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-3375961f-f610-4432-85ad-661095d226ec None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:32.105579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3375961f-f610-4432-85ad-661095d226ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:32.192774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:32.247546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 123/245] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:32.248391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 123/246] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:32.258882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375961f-f610-4432-85ad-661095d226ec None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:32.271676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:32.393555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900d26-7d91-4508-86fa-2db23e64e6d1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:32.431055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375961f-f610-4432-85ad-661095d226ec None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:32.434930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:32.435739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.436027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.436316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.448951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:32.460376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:32.461747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:32.462619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 124/247] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:32.471051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:32.483031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:32.484236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.484820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.485298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.487230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:32.489289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:32.492784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 124/248] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:32 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:32.498036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:32.503634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:32.523545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:32.611430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa120d9-38b9-49ab-9cef-b3ae2c848820 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:32.642678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c647-d4da-4a37-95f1-c19e34018346 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:32.658036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:32.659474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.660218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.660700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.661894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:32.662385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:32.665356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:32.677939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 125/249] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:32.683580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:32.691325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:32.692133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.692535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.692934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.693866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] RBAC: Adding query filter params (role.id=eb84f3c1359e4f64a2e501ff0bea36a8, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=f0e3b163051740fd8b87a93cf1b75272) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:32.694252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:32.695837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:32.702729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 125/250] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:32 2022] GET /identity/v3/role_assignments?user.id=f0e3b163051740fd8b87a93cf1b75272&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=eb84f3c1359e4f64a2e501ff0bea36a8 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:32.795391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:32.801365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aeb93-f776-4b3d-b211-d1c773240f11 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:32.840811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:32.841716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:32.842002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:32.842281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] PATH_INFO: `/v3/users/79c8cc6891f840d78c7ffb5e8943e936` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:32.843521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] RBAC: Authorizing `identity:get_user(user_id=79c8cc6891f840d78c7ffb5e8943e936)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:32.845050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:32.847042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 126/251] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:32 2022] GET /identity/v3/users/79c8cc6891f840d78c7ffb5e8943e936 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:32.853634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:32.936845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:32.976764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1424-8373-4ce0-8783-9376736bd936 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:33.019799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28b7cd-e4bb-41cc-8c26-6a2851ac261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:33.020761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28b7cd-e4bb-41cc-8c26-6a2851ac261b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.021094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28b7cd-e4bb-41cc-8c26-6a2851ac261b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.021379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28b7cd-e4bb-41cc-8c26-6a2851ac261b None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.022636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28b7cd-e4bb-41cc-8c26-6a2851ac261b None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:33.024649 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28b7cd-e4bb-41cc-8c26-6a2851ac261b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:33.026680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 126/252] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:32 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:33.033702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:33.129404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0922-5062-468b-b40d-27a6b7bca259 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.129905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0922-5062-468b-b40d-27a6b7bca259 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.129905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0922-5062-468b-b40d-27a6b7bca259 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.131242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 127/253] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:33.146406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970b6f-e0e2-4fb0-b700-c57cdb7f61a3 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.146695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970b6f-e0e2-4fb0-b700-c57cdb7f61a3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.146970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970b6f-e0e2-4fb0-b700-c57cdb7f61a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.175622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712efc4-ab89-49bf-bcef-0148dcbb222b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:33.178028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-6d970b6f-e0e2-4fb0-b700-c57cdb7f61a3 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:33.179286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-6d970b6f-e0e2-4fb0-b700-c57cdb7f61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:33.240517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec256bde-3d34-4c1b-ad59-8b61596b47bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:33.241442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec256bde-3d34-4c1b-ad59-8b61596b47bd None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.241763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec256bde-3d34-4c1b-ad59-8b61596b47bd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.242045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec256bde-3d34-4c1b-ad59-8b61596b47bd None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/79c8cc6891f840d78c7ffb5e8943e936/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.246429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec256bde-3d34-4c1b-ad59-8b61596b47bd None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3747467244a2087fc57f41a3d33b6, user_id=79c8cc6891f840d78c7ffb5e8943e936, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:33.248125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec256bde-3d34-4c1b-ad59-8b61596b47bd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:33.278407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 127/254] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:33 2022] PUT /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/79c8cc6891f840d78c7ffb5e8943e936/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:33.279783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86b16-c887-4f3e-9e2c-b5bcffd11be4 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.280089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86b16-c887-4f3e-9e2c-b5bcffd11be4 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.280412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86b16-c887-4f3e-9e2c-b5bcffd11be4 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.281886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 128/255] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:33.289972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860547a0-d558-478f-b190-a2a70accc58c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.291895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860547a0-d558-478f-b190-a2a70accc58c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.292179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860547a0-d558-478f-b190-a2a70accc58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.326464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-860547a0-d558-478f-b190-a2a70accc58c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:33.330064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 128/256] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:33.331143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-860547a0-d558-478f-b190-a2a70accc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:33.364608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d970b6f-e0e2-4fb0-b700-c57cdb7f61a3 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:33.369199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:33.466813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 129/257] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:33.480735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:33.518822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860547a0-d558-478f-b190-a2a70accc58c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:33.520320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d970b6f-e0e2-4fb0-b700-c57cdb7f61a3 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:33.559884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:33.560785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.561078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.561355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.576740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:33.588902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:33.589873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:33.590664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 129/258] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:33.601603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:33.748001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860547a0-d558-478f-b190-a2a70accc58c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:33.753097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b14898-b8bc-4a2b-a9db-a892b4462338 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:33.796948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:33.816239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:33.816943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.817233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.817515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.818277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:33.818595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:33.820013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:33.826175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:33.826998 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:33.827275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:33.827544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:33.850715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 130/259] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:33.851909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:33.860149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:33.861232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:33.862027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:33.864951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 130/260] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:33.869614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:33.873934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:33.909332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:34.031960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076cb0a-1ad2-457a-98dc-e1408c6bcb3c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:34.070463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:34.071182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:34.071470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:34.071754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:34.072955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:34.073274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:34.074894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:34.084559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 131/261] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:34.089658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:34.090125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1011a-f859-47e4-a282-48b3253ba1d0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:34.166171 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:34.168148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:34.168691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:34.169162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] PATH_INFO: `/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:34.173289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:34.175177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:34.177059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 131/262] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:33 2022] GET /identity/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:34.183208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:34.220156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:34.274183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340acbb2-6cd4-4034-9d11-fb8073c82713 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:34.328865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:34.349870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:34.350763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:34.351597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:34.351885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] PATH_INFO: `/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:34.353259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2ce7a3bd384f0eab04fd9f42ddfb58)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:34.354736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:34.363875 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 132/263] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:34 2022] GET /identity/v3/users/3a2ce7a3bd384f0eab04fd9f42ddfb58 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:34.369076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:34.420609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5dee5-9fc8-485c-bae2-6af355addb64 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:34.463034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:34.463705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:34.463998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:34.464283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:34.575629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd1a9e-0c97-4b60-ae6b-411f5153a172 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:34.640159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:34.641585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:34.642536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:34.643517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:34.643812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:34.644147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:34.670024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:34.781963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:34.793652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:34.796870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:34.882821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 132/264] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 14:41:34.883686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:35.004187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 133/265] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 14:41:35.010421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:35.036697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204cf2-8c1f-4b9e-926d-e806f1668f2f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:35.114652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:35.118147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:35.119037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:35.119320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:35.119605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:35.126755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:35.128267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:35.130591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 133/266] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:34 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:35.136791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:35.185937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:35.254320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639fb18-c74d-44fa-bdf4-4fe163d13cc8 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:35.336256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:35.337317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:35.337616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:35.337907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:35.340817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53c96c-69e9-40ca-a932-f8c7a396280f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:35.343629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:35.348988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:35.348988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 134/267] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:35 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:35.357028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:35.404135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3f19-a867-41d1-b9c0-6a584d0b90dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:35.405481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3f19-a867-41d1-b9c0-6a584d0b90dd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:35.406002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3f19-a867-41d1-b9c0-6a584d0b90dd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:35.406482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3f19-a867-41d1-b9c0-6a584d0b90dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:35.407525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d3f19-a867-41d1-b9c0-6a584d0b90dd None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:35.408044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d3f19-a867-41d1-b9c0-6a584d0b90dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:35.409804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d3f19-a867-41d1-b9c0-6a584d0b90dd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:35.421551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 134/268] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:35 2022] GET /identity/v3/role_assignments?user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:35.561761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5adb-1cce-4532-bd48-c9ac8c5bb606 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:35.582298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:35.613921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065440a6-9686-40b9-bfbb-cff700fed1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:35.614531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065440a6-9686-40b9-bfbb-cff700fed1b4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:35.614818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065440a6-9686-40b9-bfbb-cff700fed1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:35.615098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065440a6-9686-40b9-bfbb-cff700fed1b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:35.615943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065440a6-9686-40b9-bfbb-cff700fed1b4 None admin] RBAC: Adding query filter params (role.id=8888db000f97433e8f047879704f3916, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:35.616261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065440a6-9686-40b9-bfbb-cff700fed1b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:35.618367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065440a6-9686-40b9-bfbb-cff700fed1b4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:35.630174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 135/269] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:35 2022] GET /identity/v3/role_assignments?user.id=3a2ce7a3bd384f0eab04fd9f42ddfb58&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=8888db000f97433e8f047879704f3916 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:35.657678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1d98-fa60-4759-ad2d-65c0b43f4ebf None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:35.657678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1d98-fa60-4759-ad2d-65c0b43f4ebf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:35.658332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1d98-fa60-4759-ad2d-65c0b43f4ebf None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:35.660236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 135/270] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:35.666090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462dc8-cd40-42fc-b65b-505869afb24b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:35.666407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462dc8-cd40-42fc-b65b-505869afb24b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:35.666652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462dc8-cd40-42fc-b65b-505869afb24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:35.693687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-23462dc8-cd40-42fc-b65b-505869afb24b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:35.694947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-23462dc8-cd40-42fc-b65b-505869afb24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:35.789965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 136/271] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:35.821794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1d98-fa60-4759-ad2d-65c0b43f4ebf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:35.923257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:35.939829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1d98-fa60-4759-ad2d-65c0b43f4ebf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:35.983529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e57c3-664a-4d00-8bce-ec8a901af467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:35.984360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e57c3-664a-4d00-8bce-ec8a901af467 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:35.984683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e57c3-664a-4d00-8bce-ec8a901af467 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:35.984961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e57c3-664a-4d00-8bce-ec8a901af467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:35.997364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e57c3-664a-4d00-8bce-ec8a901af467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-d99e57c3-664a-4d00-8bce-ec8a901af467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:36.005603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:36.006536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:36.007376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 136/272] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:36.012791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23462dc8-cd40-42fc-b65b-505869afb24b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.042348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849f5f-bfd7-43de-adae-189cc36a2603 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.042895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849f5f-bfd7-43de-adae-189cc36a2603 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.043162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849f5f-bfd7-43de-adae-189cc36a2603 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.044596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 137/273] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:36.051187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa33853-7cb4-4bf2-8c9e-c263e0cd9aa1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.051483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa33853-7cb4-4bf2-8c9e-c263e0cd9aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.051774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa33853-7cb4-4bf2-8c9e-c263e0cd9aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.072754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ffa33853-7cb4-4bf2-8c9e-c263e0cd9aa1 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:36.074470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ffa33853-7cb4-4bf2-8c9e-c263e0cd9aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:36.151574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23462dc8-cd40-42fc-b65b-505869afb24b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.161807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 138/274] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:36.163464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:36.202849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa33853-7cb4-4bf2-8c9e-c263e0cd9aa1 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.216326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc387b-ed9f-4cad-a54d-466db5831fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:36.217115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc387b-ed9f-4cad-a54d-466db5831fcc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.217448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc387b-ed9f-4cad-a54d-466db5831fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.217724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc387b-ed9f-4cad-a54d-466db5831fcc None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.218489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc387b-ed9f-4cad-a54d-466db5831fcc None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:36.218791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc387b-ed9f-4cad-a54d-466db5831fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:36.220265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc387b-ed9f-4cad-a54d-466db5831fcc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:36.231712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 137/275] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:36.233959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1786-99f4-4817-aa3b-29fa806d99f4 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.234608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1786-99f4-4817-aa3b-29fa806d99f4 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.235122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1786-99f4-4817-aa3b-29fa806d99f4 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.236943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 138/276] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:36.237849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1786-99f4-4817-aa3b-29fa806d99f4 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.301619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:36.327144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa33853-7cb4-4bf2-8c9e-c263e0cd9aa1 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.349292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1786-99f4-4817-aa3b-29fa806d99f4 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.362819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff3d64-91f1-4c02-b0f6-70c25c7a1d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:36.363782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff3d64-91f1-4c02-b0f6-70c25c7a1d0d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.364064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff3d64-91f1-4c02-b0f6-70c25c7a1d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.364341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff3d64-91f1-4c02-b0f6-70c25c7a1d0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.377429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff3d64-91f1-4c02-b0f6-70c25c7a1d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-19ff3d64-91f1-4c02-b0f6-70c25c7a1d0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:36.386182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:36.387137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:36.387972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:36.388574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:36.388574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.388574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.388825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 139/277] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:36.388892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] PATH_INFO: `/v3/users/63177eb816c545558459b0ff5bac6a92` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.394030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0c34a-433e-4c55-84f9-ec5327c87286 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.394349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0c34a-433e-4c55-84f9-ec5327c87286 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.394603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0c34a-433e-4c55-84f9-ec5327c87286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.405119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] RBAC: Authorizing `identity:get_user(user_id=63177eb816c545558459b0ff5bac6a92)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:36.406612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:36.412891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 139/278] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/users/63177eb816c545558459b0ff5bac6a92 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:36.412891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.417972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-fed0c34a-433e-4c55-84f9-ec5327c87286 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:36.419165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fed0c34a-433e-4c55-84f9-ec5327c87286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:36.438688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:36.492629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 140/279] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:36.492629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0c34a-433e-4c55-84f9-ec5327c87286 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.527971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b26cc7-0799-4051-9591-c7155367f586 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.559619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:36.566492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:36.567169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.567457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.567736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.568486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:36.568827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:36.570877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:36.578972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 140/280] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:36.579892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.594653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0c34a-433e-4c55-84f9-ec5327c87286 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.628692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01ca1-a131-49be-9727-856f02519f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:36.629510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ca1-a131-49be-9727-856f02519f42 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.630017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ca1-a131-49be-9727-856f02519f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.630502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ca1-a131-49be-9727-856f02519f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.631730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd01ca1-a131-49be-9727-856f02519f42 None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, user.id=63177eb816c545558459b0ff5bac6a92, scope.system=all) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:36.632990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd01ca1-a131-49be-9727-856f02519f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:36.635048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd01ca1-a131-49be-9727-856f02519f42 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:36.640866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 141/281] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/role_assignments?user.id=63177eb816c545558459b0ff5bac6a92&scope.system=all&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:36.646098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37aff-2c4c-4912-b460-31c6c2064985 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.646388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37aff-2c4c-4912-b460-31c6c2064985 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.646670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37aff-2c4c-4912-b460-31c6c2064985 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.648082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 142/282] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:36.653014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db37aff-2c4c-4912-b460-31c6c2064985 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.681996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:36.702792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba390e-c346-46dd-88a4-754236df7e9d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.753417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79546-03f1-4125-a23e-b34fa12c67bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:36.754981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79546-03f1-4125-a23e-b34fa12c67bc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.754981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79546-03f1-4125-a23e-b34fa12c67bc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.754981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79546-03f1-4125-a23e-b34fa12c67bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.756090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79546-03f1-4125-a23e-b34fa12c67bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:36.758316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79546-03f1-4125-a23e-b34fa12c67bc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:36.760189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 141/283] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:36.761473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629a85-4dbb-42e7-9e8d-d720b96c7b16 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.761837 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629a85-4dbb-42e7-9e8d-d720b96c7b16 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.762161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629a85-4dbb-42e7-9e8d-d720b96c7b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.780738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-bc629a85-4dbb-42e7-9e8d-d720b96c7b16 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:36.781978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bc629a85-4dbb-42e7-9e8d-d720b96c7b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:36.797472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db37aff-2c4c-4912-b460-31c6c2064985 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.831453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:36.836793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:36.838466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:36.839277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:36.839909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] PATH_INFO: `/v3/users/f0e3b163051740fd8b87a93cf1b75272` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:36.841494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e3b163051740fd8b87a93cf1b75272)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:36.842595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:36.844463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 143/284] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/users/f0e3b163051740fd8b87a93cf1b75272 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:36.845031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.858987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 142/285] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:36.860137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629a85-4dbb-42e7-9e8d-d720b96c7b16 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:36.946852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:36.964527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629a85-4dbb-42e7-9e8d-d720b96c7b16 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:36.968635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830879-435f-49d1-b6c1-1b5496bb80c1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:37.008888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:37.009566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:37.009853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:37.010134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:37.010844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:37.011666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:37.012293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:37.012524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:37.012834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:37.013107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:37.014263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:37.015713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:37.017647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 143/286] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:36 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:37.018320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:37.044758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 144/287] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:41:36 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:37.044758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:37.116312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:37.177065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342918ff-e3aa-4367-bb41-b56695e92487 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:37.185938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919b6c-30e5-4cd9-8877-b4c21eaae068 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:37.225625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:37.227126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:37.227408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:37.227685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:37.232068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:37.233175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:37.233607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:37.233893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/f0e3b163051740fd8b87a93cf1b75272/roles/eb84f3c1359e4f64a2e501ff0bea36a8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:37.236621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3747467244a2087fc57f41a3d33b6, user_id=f0e3b163051740fd8b87a93cf1b75272, role_id=eb84f3c1359e4f64a2e501ff0bea36a8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:37.238091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:37.239373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:37.248138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:37.249103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:37.249893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 144/288] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:37.253440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 145/289] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:41:37 2022] PUT /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6/users/f0e3b163051740fd8b87a93cf1b75272/roles/eb84f3c1359e4f64a2e501ff0bea36a8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:37.255539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:37.277687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:37.383642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97127-8376-43ad-8505-fabd1d486f73 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:37.425428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:37.426138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:37.426428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:37.426716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:37.427505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:37.427822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:37.429451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:37.440488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 145/290] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:37.446434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:37.559997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470d64f-2d3c-4b15-a18e-db97cfff1b0f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:37.577127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:37.596811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:37.598074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:37.598362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:37.598645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] PATH_INFO: `/v3/users/79c8cc6891f840d78c7ffb5e8943e936` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:37.599870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] RBAC: Authorizing `identity:get_user(user_id=79c8cc6891f840d78c7ffb5e8943e936)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:37.601392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:37.603335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 146/291] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:37 2022] GET /identity/v3/users/79c8cc6891f840d78c7ffb5e8943e936 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:37.608842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:37.690425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:37.715032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2fc65-c66a-4a94-bb56-d525de8772d1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:37.749604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:37.750267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:37.750556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:37.750842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:37.824115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:37.825654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:37.904524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:37.929858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 146/292] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:37.937912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:38.086580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae89a98-39e5-4b35-9c96-efcde036146b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:38.152477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab1552-9572-4cec-a982-2221f4afd461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:38.153385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1552-9572-4cec-a982-2221f4afd461 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:38.153668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1552-9572-4cec-a982-2221f4afd461 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:38.153947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1552-9572-4cec-a982-2221f4afd461 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:38.155137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab1552-9572-4cec-a982-2221f4afd461 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:38.156618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab1552-9572-4cec-a982-2221f4afd461 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:38.162719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 147/293] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:37 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:38.164033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:38.309959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361cc7c-9639-41a4-9be6-9f224e02931d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:38.364956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4979847-c0ca-4bac-918d-7e219502f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:38.365544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979847-c0ca-4bac-918d-7e219502f48a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:38.365833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979847-c0ca-4bac-918d-7e219502f48a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:38.366117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979847-c0ca-4bac-918d-7e219502f48a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:38.367531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979847-c0ca-4bac-918d-7e219502f48a None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=79c8cc6891f840d78c7ffb5e8943e936) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:38.367850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979847-c0ca-4bac-918d-7e219502f48a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:38.369332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979847-c0ca-4bac-918d-7e219502f48a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:38.376000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 147/294] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:38 2022] GET /identity/v3/role_assignments?user.id=79c8cc6891f840d78c7ffb5e8943e936&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:39.206980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ae0ab-b393-41b9-b8fc-ca286ec0d9de None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.207497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ae0ab-b393-41b9-b8fc-ca286ec0d9de None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.207581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ae0ab-b393-41b9-b8fc-ca286ec0d9de None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.211218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 148/295] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:39.215645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a899b0-3f8a-42e6-8a6b-9401d804cf48 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.216038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a899b0-3f8a-42e6-8a6b-9401d804cf48 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.216199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a899b0-3f8a-42e6-8a6b-9401d804cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.236345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-33a899b0-3f8a-42e6-8a6b-9401d804cf48 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:39.237574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-33a899b0-3f8a-42e6-8a6b-9401d804cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:39.276284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:39.311341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 148/296] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:39.335131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ae0ab-b393-41b9-b8fc-ca286ec0d9de None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:39.391965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:39.443172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ae0ab-b393-41b9-b8fc-ca286ec0d9de None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:39.479880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:39.481237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.481540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.481821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.493507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:39.501414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:39.502387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:39.503232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 149/297] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:39.509427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a899b0-3f8a-42e6-8a6b-9401d804cf48 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:39.611376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a899b0-3f8a-42e6-8a6b-9401d804cf48 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:39.646645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:39.647344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.647626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.647952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.648762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:39.649075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:39.650557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:39.661428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 149/298] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:39.667412 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:39.779100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1bd1-83ce-4504-8346-7f2fba9f13af None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:39.797405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:39.820280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc81121-2ef5-4b87-ba6b-0e7d1133eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:39.821199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc81121-2ef5-4b87-ba6b-0e7d1133eda3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.821484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc81121-2ef5-4b87-ba6b-0e7d1133eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.821757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc81121-2ef5-4b87-ba6b-0e7d1133eda3 None admin] PATH_INFO: `/v3/users/63177eb816c545558459b0ff5bac6a92` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.822982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc81121-2ef5-4b87-ba6b-0e7d1133eda3 None admin] RBAC: Authorizing `identity:get_user(user_id=63177eb816c545558459b0ff5bac6a92)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:39.824426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc81121-2ef5-4b87-ba6b-0e7d1133eda3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:39.826397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 150/299] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:39 2022] GET /identity/v3/users/63177eb816c545558459b0ff5bac6a92 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:39.831948 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:39.850409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863a80-ab4a-400e-b5c8-0d350ef46dbd None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.850743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863a80-ab4a-400e-b5c8-0d350ef46dbd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.851493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863a80-ab4a-400e-b5c8-0d350ef46dbd None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.852918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 151/300] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:39.859195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91557-b5d0-4299-93c4-cd5cd06b4b1c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.859488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91557-b5d0-4299-93c4-cd5cd06b4b1c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.859771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91557-b5d0-4299-93c4-cd5cd06b4b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.873799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:39.879584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-49c91557-b5d0-4299-93c4-cd5cd06b4b1c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:39.880893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-49c91557-b5d0-4299-93c4-cd5cd06b4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:39.945763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc23c14-5e68-4393-bf46-3ceb05c19928 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:39.953921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 152/301] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:39.955311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe073ab-5145-405e-8b10-7ea090faa1cd None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.955607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe073ab-5145-405e-8b10-7ea090faa1cd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.955891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe073ab-5145-405e-8b10-7ea090faa1cd None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.960274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 153/302] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:39.960274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe789-cdba-4e0f-a36c-d0dfdeb116f2 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.960274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe789-cdba-4e0f-a36c-d0dfdeb116f2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.960274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe789-cdba-4e0f-a36c-d0dfdeb116f2 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.960274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 154/303] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:39.965083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede43271-6004-419e-99dd-a77ab2cbf557 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.965376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede43271-6004-419e-99dd-a77ab2cbf557 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.965703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede43271-6004-419e-99dd-a77ab2cbf557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.983548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ede43271-6004-419e-99dd-a77ab2cbf557 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:39.984752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ede43271-6004-419e-99dd-a77ab2cbf557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:39.986447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fc49d-cc09-4201-9b31-69efc659e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:39.987313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc49d-cc09-4201-9b31-69efc659e18e None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:39.987603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc49d-cc09-4201-9b31-69efc659e18e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:39.987886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc49d-cc09-4201-9b31-69efc659e18e None admin] PATH_INFO: `/v3/system/users/63177eb816c545558459b0ff5bac6a92/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:39.989420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fc49d-cc09-4201-9b31-69efc659e18e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=63177eb816c545558459b0ff5bac6a92, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:39.990814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fc49d-cc09-4201-9b31-69efc659e18e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:39.999483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 150/304] 10.222.0.59 () {58 vars in 1334 bytes} [Wed May 18 14:41:39 2022] PUT /identity/v3/system/users/63177eb816c545558459b0ff5bac6a92/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:41:40.012818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f5ee-4d5d-4b77-8869-0bb34b97ce36 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.012818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f5ee-4d5d-4b77-8869-0bb34b97ce36 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.012818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f5ee-4d5d-4b77-8869-0bb34b97ce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.020215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e266f5ee-4d5d-4b77-8869-0bb34b97ce36 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:40.021511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e266f5ee-4d5d-4b77-8869-0bb34b97ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:40.062567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 155/305] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:40.063289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede43271-6004-419e-99dd-a77ab2cbf557 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.107745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 151/306] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:40.108935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f5ee-4d5d-4b77-8869-0bb34b97ce36 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.112917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.151392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.203237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede43271-6004-419e-99dd-a77ab2cbf557 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.242178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.242995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.243347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.243579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.255704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:40.260947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f5ee-4d5d-4b77-8869-0bb34b97ce36 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:40.264161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:40.265251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:40.266032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 156/307] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:40.270766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.297058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.297863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.298150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.298434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.299617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:40.301119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:40.302740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 152/308] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:40.305545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.377017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.379870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560386-5111-4dd4-91b2-bc9d8f11d113 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.412734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.415386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.416368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.416678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.417090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.421345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe6916-5c10-4ad5-b459-19cc953a45f7 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.427763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:40.435516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:40.436446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:40.437293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:40.441809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 157/309] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:40.442659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.459141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.459855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.460097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.460943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.461705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:40.462017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:40.463419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:40.472064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 153/310] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:40.472064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.552489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bf43-862d-4464-8676-0a5f2f778076 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.593552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.594471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.594761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.595057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] PATH_INFO: `/v3/groups` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.595741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:40.597248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:40.601908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd339b2-0cc6-4106-81ad-f1214a1254d1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.613678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 158/311] 10.222.0.59 () {60 vars in 1134 bytes} [Wed May 18 14:41:40 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:40.615132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.640671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.641484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.641842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.642194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.643048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:40.643472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:40.645106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:40.655639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 154/312] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:40.656847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.661736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.684623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.775217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0c80-4562-47f8-b912-eeb8705be856 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.783648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328fc34-891a-4320-9f2a-ccd1d6e78a93 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.822974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.823957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.824310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.824703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] PATH_INFO: `/v3/users/7c2ec3a5cad44098bf6023fcfd4034eb` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.827131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:40.829187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:40.829680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:40.830138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] PATH_INFO: `/v3/users/f0e3b163051740fd8b87a93cf1b75272` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:40.831567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] RBAC: Authorizing `identity:get_user(user_id=f0e3b163051740fd8b87a93cf1b75272)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:40.833841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:40.836542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 155/313] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/users/f0e3b163051740fd8b87a93cf1b75272 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:40.842222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] RBAC: Authorizing `identity:get_user(user_id=7c2ec3a5cad44098bf6023fcfd4034eb)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:40.842432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.843890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:40.846060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 159/314] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/users/7c2ec3a5cad44098bf6023fcfd4034eb => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:40.851316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:40.947921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.950764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:40.968800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cc27c-13fe-4b69-94bf-70ce881247e4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:40.977089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0cd0b-eb5b-41e8-b253-3be5195df557 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:41.006813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:41.008189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:41.008658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:41.009012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:41.021555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:41.022725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:41.023019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:41.023301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:41.024861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] RBAC: Adding query filter params (role.id=eb84f3c1359e4f64a2e501ff0bea36a8, user.id=7c2ec3a5cad44098bf6023fcfd4034eb, scope.system=all) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:41.025188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:41.026904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:41.034279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 160/315] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/role_assignments?user.id=7c2ec3a5cad44098bf6023fcfd4034eb&scope.system=all&role.id=eb84f3c1359e4f64a2e501ff0bea36a8 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:41.097070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:41.098662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:41.201092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:41.219203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 156/316] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 14:41:41.229727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:41.338470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd041b1-3150-4cbe-b1ad-839145f3778a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:41.374456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc08bfe-f4de-484f-b738-321b75513f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:41.375663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08bfe-f4de-484f-b738-321b75513f90 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:41.376157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08bfe-f4de-484f-b738-321b75513f90 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:41.376699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08bfe-f4de-484f-b738-321b75513f90 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:41.378112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc08bfe-f4de-484f-b738-321b75513f90 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:41.379773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc08bfe-f4de-484f-b738-321b75513f90 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:41.381732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 161/317] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:41 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:41.392627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:41.494603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f33a-b19c-45cb-96c8-d626f612d3ac None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:41.529294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7693fd-c17c-4b21-9786-ddf23e7bb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:41.529955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7693fd-c17c-4b21-9786-ddf23e7bb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:41.530243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7693fd-c17c-4b21-9786-ddf23e7bb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:41.530522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7693fd-c17c-4b21-9786-ddf23e7bb8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:41.531362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7693fd-c17c-4b21-9786-ddf23e7bb8a7 None admin] RBAC: Adding query filter params (role.id=eb84f3c1359e4f64a2e501ff0bea36a8, scope.project.id=0ae3747467244a2087fc57f41a3d33b6, user.id=f0e3b163051740fd8b87a93cf1b75272) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:41.531676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7693fd-c17c-4b21-9786-ddf23e7bb8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:41.533175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7693fd-c17c-4b21-9786-ddf23e7bb8a7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:41.540196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 157/318] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:41:41 2022] GET /identity/v3/role_assignments?user.id=f0e3b163051740fd8b87a93cf1b75272&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=eb84f3c1359e4f64a2e501ff0bea36a8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:42.299755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d3f7-e5ca-4db7-bba3-eab8969eee6c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:42.300047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d3f7-e5ca-4db7-bba3-eab8969eee6c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:42.300496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7d3f7-e5ca-4db7-bba3-eab8969eee6c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:42.302044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 162/319] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:42.307422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9db55-18a5-46ea-9e7f-f9f1e10bd76e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:42.307903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9db55-18a5-46ea-9e7f-f9f1e10bd76e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:42.308350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9db55-18a5-46ea-9e7f-f9f1e10bd76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:42.325862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-30d9db55-18a5-46ea-9e7f-f9f1e10bd76e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:42.327240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-30d9db55-18a5-46ea-9e7f-f9f1e10bd76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:42.375497 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:42.400512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 158/320] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:42.423157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7d3f7-e5ca-4db7-bba3-eab8969eee6c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:42.436129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:42.527645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7d3f7-e5ca-4db7-bba3-eab8969eee6c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:42.562115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:42.562910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:42.563197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:42.563477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:42.574164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:42.581954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:42.582837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:42.583633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 163/321] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:42.590177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9db55-18a5-46ea-9e7f-f9f1e10bd76e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:42.690969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9db55-18a5-46ea-9e7f-f9f1e10bd76e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:42.725688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:42.726361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:42.726647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:42.726923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:42.727667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:42.727975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:42.729401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:42.742727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 159/322] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:42.743771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:42.817602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:42.849848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76941-2840-4369-8e2d-0552c90fcc91 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:42.883468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adec74c-1ed2-4510-a178-8167b9da30bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:42.884350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec74c-1ed2-4510-a178-8167b9da30bf None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:42.884657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec74c-1ed2-4510-a178-8167b9da30bf None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:42.884939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec74c-1ed2-4510-a178-8167b9da30bf None admin] PATH_INFO: `/v3/users/63177eb816c545558459b0ff5bac6a92` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:42.886131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adec74c-1ed2-4510-a178-8167b9da30bf None admin] RBAC: Authorizing `identity:get_user(user_id=63177eb816c545558459b0ff5bac6a92)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:42.887589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adec74c-1ed2-4510-a178-8167b9da30bf None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:42.889419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 164/323] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:42 2022] GET /identity/v3/users/63177eb816c545558459b0ff5bac6a92 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:42.895064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:42.940620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41337d6-f79c-4727-9f2c-8ab148b19ecc None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:42.940620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41337d6-f79c-4727-9f2c-8ab148b19ecc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:42.940620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41337d6-f79c-4727-9f2c-8ab148b19ecc None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:42.942073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 165/324] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:42.944080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:42.947263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c05f6-321c-4f15-aae4-ca5af81454a5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:42.947555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c05f6-321c-4f15-aae4-ca5af81454a5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:42.947840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c05f6-321c-4f15-aae4-ca5af81454a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:42.964365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-032c05f6-321c-4f15-aae4-ca5af81454a5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:42.965645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-032c05f6-321c-4f15-aae4-ca5af81454a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:43.007782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288708c-bb32-417f-98e1-74ed3c19a2e9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:43.038060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 166/325] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:43.044030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:43.044893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.045318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.045758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.046728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] RBAC: Adding query filter params (role.id=c906bb6cd0b942fb94f3f843cb8094e5, user.id=63177eb816c545558459b0ff5bac6a92, scope.system=all) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:43.047184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:43.048793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:43.061379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c05f6-321c-4f15-aae4-ca5af81454a5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:43.061854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 160/326] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 18 14:41:42 2022] GET /identity/v3/role_assignments?user.id=63177eb816c545558459b0ff5bac6a92&scope.system=all&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:43.142977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:43.181046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c05f6-321c-4f15-aae4-ca5af81454a5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:43.225361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc2813-acf1-49d0-97c7-c8414acb220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:43.226768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2813-acf1-49d0-97c7-c8414acb220c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.227048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2813-acf1-49d0-97c7-c8414acb220c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.227326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2813-acf1-49d0-97c7-c8414acb220c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.228606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc2813-acf1-49d0-97c7-c8414acb220c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:43.230098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc2813-acf1-49d0-97c7-c8414acb220c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:43.231973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 167/327] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:43.237610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:43.273260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5555e9-5ce6-4663-809f-41b6033d1e9b None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.273560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5555e9-5ce6-4663-809f-41b6033d1e9b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.273827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5555e9-5ce6-4663-809f-41b6033d1e9b None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.275502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 168/328] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:43.280445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b51df-c289-42ae-ad74-75b29efef453 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.280761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b51df-c289-42ae-ad74-75b29efef453 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.281039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b51df-c289-42ae-ad74-75b29efef453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.301299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e33b51df-c289-42ae-ad74-75b29efef453 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:43.302474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e33b51df-c289-42ae-ad74-75b29efef453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:43.341518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:43.344467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c179ff-e599-4eb9-9c39-c414e24507b1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:43.370159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 169/329] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:43.377716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:43.378379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.378662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.378941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] PATH_INFO: `/v3/groups` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.379629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:43.381114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:43.392118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b51df-c289-42ae-ad74-75b29efef453 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:43.395074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 161/330] 10.222.0.59 () {60 vars in 1134 bytes} [Wed May 18 14:41:43 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:41:43.469196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:43.505883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b51df-c289-42ae-ad74-75b29efef453 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:43.541707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:43.542520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.543064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.543342 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.554519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:43.562534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:43.563542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:43.564324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:43.568622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 170/331] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:43.570639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:43.679687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adcd48-b7c0-4a13-8f2c-a1405fbf5953 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:43.720221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:43.720935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.721226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.721511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.722271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:43.722593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:43.723999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:43.732682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 162/332] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:43.738037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:43.848019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb862c-5734-417f-9bbd-f208bb588cb5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:43.874070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:43.884301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f326b-a10a-44c0-b8fa-c7a662af81e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:43.885214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f326b-a10a-44c0-b8fa-c7a662af81e2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:43.885498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f326b-a10a-44c0-b8fa-c7a662af81e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:43.885775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f326b-a10a-44c0-b8fa-c7a662af81e2 None admin] PATH_INFO: `/v3/users/7c2ec3a5cad44098bf6023fcfd4034eb` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:43.886969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f326b-a10a-44c0-b8fa-c7a662af81e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7c2ec3a5cad44098bf6023fcfd4034eb)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:43.888421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f326b-a10a-44c0-b8fa-c7a662af81e2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:43.890427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 171/333] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:43 2022] GET /identity/v3/users/7c2ec3a5cad44098bf6023fcfd4034eb => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:43.895681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:43.928249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:44.026464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fa7f-3c7d-4710-be5c-95c4b81ec88c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:44.063795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a49fb-1637-4e19-b880-16294b78fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:44.065079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a49fb-1637-4e19-b880-16294b78fda9 None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:44.065596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a49fb-1637-4e19-b880-16294b78fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:44.066090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a49fb-1637-4e19-b880-16294b78fda9 None admin] PATH_INFO: `/v3/system/users/7c2ec3a5cad44098bf6023fcfd4034eb/roles/eb84f3c1359e4f64a2e501ff0bea36a8` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:44.067818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a49fb-1637-4e19-b880-16294b78fda9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7c2ec3a5cad44098bf6023fcfd4034eb, role_id=eb84f3c1359e4f64a2e501ff0bea36a8)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:44.070156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a49fb-1637-4e19-b880-16294b78fda9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:44.084085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 163/334] 10.222.0.59 () {58 vars in 1334 bytes} [Wed May 18 14:41:43 2022] PUT /identity/v3/system/users/7c2ec3a5cad44098bf6023fcfd4034eb/roles/eb84f3c1359e4f64a2e501ff0bea36a8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:46.536217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530762c0-b1a3-44c8-98c0-d22d9cda9a50 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:46.537221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530762c0-b1a3-44c8-98c0-d22d9cda9a50 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:46.537744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530762c0-b1a3-44c8-98c0-d22d9cda9a50 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:46.539901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 172/335] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:46.548567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff32c8-760b-4b55-a9ba-73e4588b2cf5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:46.549487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff32c8-760b-4b55-a9ba-73e4588b2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:46.549983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff32c8-760b-4b55-a9ba-73e4588b2cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:46.571934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d7ff32c8-760b-4b55-a9ba-73e4588b2cf5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:46.573511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d7ff32c8-760b-4b55-a9ba-73e4588b2cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:46.599248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9141d-589c-4bfa-bca5-5b1fbc58f941 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:46.599248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9141d-589c-4bfa-bca5-5b1fbc58f941 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:46.599248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9141d-589c-4bfa-bca5-5b1fbc58f941 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:46.599959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 173/336] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:46.605668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9bd54-bf30-4ad1-91ef-2c680f3290cb None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:46.606232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9bd54-bf30-4ad1-91ef-2c680f3290cb None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:46.606732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9bd54-bf30-4ad1-91ef-2c680f3290cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:46.637606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-87d9bd54-bf30-4ad1-91ef-2c680f3290cb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:46.639197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-87d9bd54-bf30-4ad1-91ef-2c680f3290cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:46.687277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 164/337] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:46.688892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3717-6fb3-4dd5-b81a-1dbab0f57c3f None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:46.689344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3717-6fb3-4dd5-b81a-1dbab0f57c3f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:46.689770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3717-6fb3-4dd5-b81a-1dbab0f57c3f None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:46.691178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 165/338] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:46.697222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c00c-8793-4a47-99f7-88ab8f433604 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:46.697697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c00c-8793-4a47-99f7-88ab8f433604 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:46.698130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c00c-8793-4a47-99f7-88ab8f433604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:46.725716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-15a5c00c-8793-4a47-99f7-88ab8f433604 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:46.727165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-15a5c00c-8793-4a47-99f7-88ab8f433604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:46.744965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:46.745770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 174/339] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:46.746728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9bd54-bf30-4ad1-91ef-2c680f3290cb None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:46.867359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 166/340] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:46.869026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c00c-8793-4a47-99f7-88ab8f433604 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:46.874266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9bd54-bf30-4ad1-91ef-2c680f3290cb None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:46.901151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:46.921675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:46.922490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:46.922774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:46.923054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:46.946127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:46.957648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:46.958635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:46.959478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:46.960943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 175/341] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:46.960943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:47.026548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c00c-8793-4a47-99f7-88ab8f433604 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:47.117569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:47.118478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:47.118859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:47.119231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:47.133655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d5f2-8283-435b-87e1-2ff34add80bf None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:47.134272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:47.150940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:47.151907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:47.152717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 167/342] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:47.154686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:47.169666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:47.181237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:47.182341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:47.183550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:47.184002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:47.205773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:47.214757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:47.215672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:47.216497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 176/343] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:47.217242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:47.271183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:47.336306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b4691-9b33-4b13-9de8-68017181940a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:47.340904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3e0e-df83-4669-8bd8-463792e0a5c6 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:47.373506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:47.374454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:47.374928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:47.375391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:47.376483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:47.377059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:47.378755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:47.388441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 177/344] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:47.389767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:47.395355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:47.396042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:47.396325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:47.396621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:47.397382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:47.398319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:47.399730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:47.417310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 168/345] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:47.418574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:47.512407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920737-2a6b-4227-a2e3-83156b84171e None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:47.528348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:47.556965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:47.558627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:47.559509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:47.560115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:47.561143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:47.561633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:47.563200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:47.575687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 178/346] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:47.576837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:47.586905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:47.668422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd60fb-59ea-4084-9ea0-6af0dc919df4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:47.713956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:47.714992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:47.715863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:47.716651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:47.749075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cb913-dddc-4a60-b075-cd418bd958c2 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:47.799445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffd419-d410-4789-b15c-8a0a36323622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:47.800249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffd419-d410-4789-b15c-8a0a36323622 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:47.800680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffd419-d410-4789-b15c-8a0a36323622 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:47.800981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffd419-d410-4789-b15c-8a0a36323622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:47.814443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:47.816138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:47.844784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:47.887567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffd419-d410-4789-b15c-8a0a36323622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:47.889624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffd419-d410-4789-b15c-8a0a36323622 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:47.903800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:47.950383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 169/347] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:47.951472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.012818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 179/348] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:48.014177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1e6fb-9cab-4d67-bd83-39a8de2b017b None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.014570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1e6fb-9cab-4d67-bd83-39a8de2b017b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.014851 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1e6fb-9cab-4d67-bd83-39a8de2b017b None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.016272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 180/349] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:48.018307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b07a1-4f92-47a7-8143-b219ca673f27 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.018784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b07a1-4f92-47a7-8143-b219ca673f27 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.019234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b07a1-4f92-47a7-8143-b219ca673f27 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.020935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 181/350] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:48.021883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b07a1-4f92-47a7-8143-b219ca673f27 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.090046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41a028-b8c7-47c3-9b3d-82c0de07aaad None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:48.120944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:48.132267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba51ac-060f-437a-97a1-5750e6d42a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:48.132968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba51ac-060f-437a-97a1-5750e6d42a22 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.133253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba51ac-060f-437a-97a1-5750e6d42a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.133533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba51ac-060f-437a-97a1-5750e6d42a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.169917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b07a1-4f92-47a7-8143-b219ca673f27 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:48.181570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:48.222890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:48.224019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.224647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.225098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.227496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:48.228761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba51ac-060f-437a-97a1-5750e6d42a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:48.229776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:48.230399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba51ac-060f-437a-97a1-5750e6d42a22 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:48.231883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 182/351] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:48.233033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.347871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 170/352] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:48.349245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc390545-1be8-4e28-a8fd-805b4eae5071 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.349536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc390545-1be8-4e28-a8fd-805b4eae5071 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.349815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc390545-1be8-4e28-a8fd-805b4eae5071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.351847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0538b-b434-4af5-bd3e-ba1ef2b9e94a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:48.368822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-cc390545-1be8-4e28-a8fd-805b4eae5071 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:48.370024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cc390545-1be8-4e28-a8fd-805b4eae5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:48.392390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f243c-963b-4628-b9f7-35e9fb8c1fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:48.393311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f243c-963b-4628-b9f7-35e9fb8c1fb5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.393593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f243c-963b-4628-b9f7-35e9fb8c1fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.393868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f243c-963b-4628-b9f7-35e9fb8c1fb5 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.395602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f243c-963b-4628-b9f7-35e9fb8c1fb5 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:48.396488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f243c-963b-4628-b9f7-35e9fb8c1fb5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:48.398438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 183/353] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:48.399410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa946bc8-4742-4d92-9a68-679a186f6e27 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.399693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa946bc8-4742-4d92-9a68-679a186f6e27 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.399962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa946bc8-4742-4d92-9a68-679a186f6e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.405615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:48.417672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-aa946bc8-4742-4d92-9a68-679a186f6e27 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:48.419928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-aa946bc8-4742-4d92-9a68-679a186f6e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:48.445557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:48.452211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 171/354] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:48.453314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc390545-1be8-4e28-a8fd-805b4eae5071 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.504695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 184/355] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:48.504695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db477d-1c24-419d-92c7-310aaf7658eb None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.504695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db477d-1c24-419d-92c7-310aaf7658eb None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.504695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db477d-1c24-419d-92c7-310aaf7658eb None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.505062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 185/356] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:48.505763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db477d-1c24-419d-92c7-310aaf7658eb None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.577602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc390545-1be8-4e28-a8fd-805b4eae5071 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:48.617295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:48.618159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.618437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.618704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.624733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db477d-1c24-419d-92c7-310aaf7658eb None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:48.631002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:48.632517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:48.634461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 172/357] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:48.635074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.673822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:48.674694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.674979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.675256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.676526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:48.678068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:48.679834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 186/358] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:48.680709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.683472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:48.711664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:48.758046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1aaf9-e3fc-4fe9-b2fe-e24e89c2d7c8 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:48.801654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff4677-a930-47ad-9f37-bfbb861dff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:48.802774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff4677-a930-47ad-9f37-bfbb861dff08 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.803042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546debf-471d-437e-8cc7-4ad38369aca6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:48.803154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff4677-a930-47ad-9f37-bfbb861dff08 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.803321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff4677-a930-47ad-9f37-bfbb861dff08 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.804543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff4677-a930-47ad-9f37-bfbb861dff08 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:48.806033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff4677-a930-47ad-9f37-bfbb861dff08 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:48.807655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 173/359] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:48.808826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af4d7-1485-4719-b1b2-054c3ed8dddf None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.809177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af4d7-1485-4719-b1b2-054c3ed8dddf None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.809464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af4d7-1485-4719-b1b2-054c3ed8dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.830428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-180af4d7-1485-4719-b1b2-054c3ed8dddf None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:48.831617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-180af4d7-1485-4719-b1b2-054c3ed8dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:48.852863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:48.853675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:48.853955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:48.854231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:48.867599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:48.875742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 187/360] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:48.883992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.915243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 174/361] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:48.915553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180af4d7-1485-4719-b1b2-054c3ed8dddf None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:48.955432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:48.991415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:49.000250 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccd8d6-e35f-4205-9373-84c01baf5ef7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.038407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180af4d7-1485-4719-b1b2-054c3ed8dddf None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.041142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.042518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.042518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.042518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.054689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:49.064121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:49.065112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:49.065915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 188/362] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:49.066610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.080293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.081081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.081371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.081660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.082496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=8888db000f97433e8f047879704f3916, scope.project.id=50358d273b27456a83e9a62e2a34ff3a) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:49.082813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.084284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.091690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 175/363] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:48 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=8888db000f97433e8f047879704f3916 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.093259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.204819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0689f6d-60c8-408f-a441-1aa7f1b371a3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.249448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:49.251280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc907f-512f-4524-87db-b998001efcf5 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.266742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.267645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.267930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.268249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.270320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.272084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.276623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 189/364] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.276971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.283958 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:49.296391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.296391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.296391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.296391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.298416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=0ae3747467244a2087fc57f41a3d33b6) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:49.299171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.301672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.309125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 176/365] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.310001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.425084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b65c58-fbcd-4adf-9bf2-c3d58e50a6ff None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.433625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dace1e-b4fd-4666-9cfe-091a73b90de4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.470444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.471325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.471713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.472102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.472881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.473104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:49.473522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.473697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.473986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.474268 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.475483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.487735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:49.492051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 190/366] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.493360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:49.499130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:49.500085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 177/367] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:49.501614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.558914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:49.575746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:49.627569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6e1cf-d32d-44fe-bfde-88f6a5e0d33d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.631185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb58ae-85cf-46fa-afe2-4e464309428b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.665696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.666610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.667060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.667589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.668771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:49.669218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.670733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.671378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.672156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.672666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.673169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.674126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=50358d273b27456a83e9a62e2a34ff3a) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:49.674477 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.676018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.682018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 191/368] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.683134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.683416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 178/369] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.684552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.822861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6989-3aa4-48ae-b990-18596b712042 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.859926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:49.899705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.900785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.901293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.901779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.902752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:49.903266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.904932 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.915132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad47bf-e72b-4ffc-a974-f8d5db701295 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:49.918930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 179/370] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.920036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:49.937224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:49.955907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:49.956873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:49.957160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:49.957439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] PATH_INFO: `/v3/users/7c2ec3a5cad44098bf6023fcfd4034eb` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:49.958663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] RBAC: Authorizing `identity:get_user(user_id=7c2ec3a5cad44098bf6023fcfd4034eb)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:49.961498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:49.963173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 192/371] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/users/7c2ec3a5cad44098bf6023fcfd4034eb => generated 293 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:49.963948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:50.094484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03c81-7550-47c7-a263-96487f90f97d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:50.142672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cda1ab-33c3-43cd-9f7b-ef0cbb1ad021 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:50.159773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:50.160439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:50.160755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:50.161032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:50.194845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:50.195510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:50.195806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:50.196094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:50.256875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:50.266075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:50.267575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:50.332940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:50.370401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 193/372] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:50.371170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:50.435706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:50.437240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:50.479424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:50.498565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db304cb-f8a9-4062-8aeb-e29b6f97a2fe None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:50.570316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:50.570979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:50.571265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:50.571545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:50.572384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] RBAC: Adding query filter params (role.id=eb84f3c1359e4f64a2e501ff0bea36a8, user.id=7c2ec3a5cad44098bf6023fcfd4034eb, scope.system=all) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:50.572734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:50.574180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:50.597093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 194/373] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 18 14:41:50 2022] GET /identity/v3/role_assignments?user.id=7c2ec3a5cad44098bf6023fcfd4034eb&scope.system=all&role.id=eb84f3c1359e4f64a2e501ff0bea36a8 => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:50.598013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:50.638479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 180/374] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:50.645268 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:50.800992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:50.829101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef71060-d2cf-42f3-9528-58f5527f0571 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:50.846539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd589a96-bd25-4472-99a9-98fd97836dc4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:50.877822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:50.879169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:50.879767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:50.880260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] PATH_INFO: `/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:50.881644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] RBAC: Authorizing `identity:get_project(project_id=0e866db7b1bd46b4b3abe110fcb71b70)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:50.883763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:50.885316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:50.886398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:50.886892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:50.887364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:50.888890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:50.890281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 195/375] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:50 2022] GET /identity/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70 => generated 344 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:50.891596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:50.891714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:50.894014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 181/376] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:50 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:50.898897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:50.904306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:51.019654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d440-cafd-4c93-8a1d-04d403d9da74 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:51.029164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e4e2-faa0-4509-991a-33c40411b1d3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:51.064116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:51.065353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:51.065875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:51.066289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:51.066464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] PATH_INFO: `/v3/groups/4e0f516261a944ada9653d9380438119` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:51.068353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:51.068353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:51.068353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:51.069401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:51.070951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:51.073265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 182/377] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:50 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:51.078612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:51.079424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] RBAC: Authorizing `identity:get_group(group_id=4e0f516261a944ada9653d9380438119)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:51.081098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:51.083468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 196/378] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:50 2022] GET /identity/v3/groups/4e0f516261a944ada9653d9380438119 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:51.088942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:51.091657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:51.182975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b079bb-e6d1-4518-b18e-5f759ce79385 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:51.196959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:51.219244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9843aa0-978d-4dbd-b06a-a91820fdf1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:51.219836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9843aa0-978d-4dbd-b06a-a91820fdf1fd None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:51.220119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9843aa0-978d-4dbd-b06a-a91820fdf1fd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:51.220391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9843aa0-978d-4dbd-b06a-a91820fdf1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:51.221256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9843aa0-978d-4dbd-b06a-a91820fdf1fd None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=8888db000f97433e8f047879704f3916, scope.project.id=0ae3747467244a2087fc57f41a3d33b6) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:51.221566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9843aa0-978d-4dbd-b06a-a91820fdf1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:51.223003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9843aa0-978d-4dbd-b06a-a91820fdf1fd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:51.230234 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 183/379] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:51 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=8888db000f97433e8f047879704f3916 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:51.284867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8390d-cfa0-4aea-8df1-c2112be750cd None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:51.342213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40938b-75b6-4bdf-a8a0-00c2d078a227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:51.342907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40938b-75b6-4bdf-a8a0-00c2d078a227 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:51.343193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40938b-75b6-4bdf-a8a0-00c2d078a227 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:51.343475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40938b-75b6-4bdf-a8a0-00c2d078a227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:51.344332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40938b-75b6-4bdf-a8a0-00c2d078a227 None admin] RBAC: Adding query filter params (group.id=4e0f516261a944ada9653d9380438119, role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=0e866db7b1bd46b4b3abe110fcb71b70) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:51.344671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40938b-75b6-4bdf-a8a0-00c2d078a227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:51.346131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40938b-75b6-4bdf-a8a0-00c2d078a227 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:51.353543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 197/380] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:51 2022] GET /identity/v3/role_assignments?group.id=4e0f516261a944ada9653d9380438119&scope.project.id=0e866db7b1bd46b4b3abe110fcb71b70&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:51.679336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10eb6-babd-4dca-9cc0-cf442a03afc9 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:51.680281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10eb6-babd-4dca-9cc0-cf442a03afc9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:51.680758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10eb6-babd-4dca-9cc0-cf442a03afc9 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:51.682341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 184/381] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:51.687862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef060-04ff-46e5-a975-bef179945c70 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:51.688418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef060-04ff-46e5-a975-bef179945c70 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:51.688911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef060-04ff-46e5-a975-bef179945c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:51.706259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-07eef060-04ff-46e5-a975-bef179945c70 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:51.707761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-07eef060-04ff-46e5-a975-bef179945c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:51.787141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 198/382] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:51.809967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10eb6-babd-4dca-9cc0-cf442a03afc9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:51.911756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:51.942927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10eb6-babd-4dca-9cc0-cf442a03afc9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:51.994735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897e714-30f8-4b91-92e1-5842e26e73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:51.995564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897e714-30f8-4b91-92e1-5842e26e73ce None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:51.995842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897e714-30f8-4b91-92e1-5842e26e73ce None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:51.996146 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897e714-30f8-4b91-92e1-5842e26e73ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.010720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897e714-30f8-4b91-92e1-5842e26e73ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b897e714-30f8-4b91-92e1-5842e26e73ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:52.019371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:52.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:52.021219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:52.024449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 185/383] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:52.030269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef060-04ff-46e5-a975-bef179945c70 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:52.123997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0f637-ca9f-4133-aabd-3306fd400bb0 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.124317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0f637-ca9f-4133-aabd-3306fd400bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.124562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0f637-ca9f-4133-aabd-3306fd400bb0 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.126225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 186/384] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:52.136899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26cd2-5c5e-477c-a710-1ff2e67d2f92 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.137187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26cd2-5c5e-477c-a710-1ff2e67d2f92 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.137468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26cd2-5c5e-477c-a710-1ff2e67d2f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.160945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:52.166117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b0e26cd2-5c5e-477c-a710-1ff2e67d2f92 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:52.167328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b0e26cd2-5c5e-477c-a710-1ff2e67d2f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:52.201784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef060-04ff-46e5-a975-bef179945c70 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:52.269684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:52.270605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.272199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.272696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.273602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:52.275324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:52.276889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:52.297367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 199/385] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:52.301865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:52.326913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 187/386] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:41:52.354417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e26cd2-5c5e-477c-a710-1ff2e67d2f92 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:52.459633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:52.478755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ac3a1-e796-4653-ac34-aa6ee19b1920 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:52.520610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e26cd2-5c5e-477c-a710-1ff2e67d2f92 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:52.541149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:52.551803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:52.553076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.553564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.554668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.557821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:52.557821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.558079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.558296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.559219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:52.560962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:52.563291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 200/387] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:52 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:52.569833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:52.577265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:52.585462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:52.586435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:52.587241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:52.589542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 188/388] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:52.602627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:52.767988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c9d94-2361-49f1-b363-b0cbe9e44748 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:52.784449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbe20b-eea4-41d1-bd9e-438a65156df7 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:52.803373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa5507-2ba3-4293-93f4-073f209f0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:52.805083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5507-2ba3-4293-93f4-073f209f0257 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.805524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5507-2ba3-4293-93f4-073f209f0257 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.805940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5507-2ba3-4293-93f4-073f209f0257 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.807428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa5507-2ba3-4293-93f4-073f209f0257 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:52.809370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa5507-2ba3-4293-93f4-073f209f0257 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:52.819334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 201/389] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:52 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:52.819334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813787e-a521-472b-8eab-1fd5d5476c6e None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.819334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813787e-a521-472b-8eab-1fd5d5476c6e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.819334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813787e-a521-472b-8eab-1fd5d5476c6e None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.819334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 202/390] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:52.819725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:52.821541 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813787e-a521-472b-8eab-1fd5d5476c6e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:52.832405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8e39-f927-4926-9319-0122e3d12451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:52.833122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8e39-f927-4926-9319-0122e3d12451 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.833412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8e39-f927-4926-9319-0122e3d12451 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.833698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8e39-f927-4926-9319-0122e3d12451 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.834458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8e39-f927-4926-9319-0122e3d12451 None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:52.834778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8e39-f927-4926-9319-0122e3d12451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:52.836690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8e39-f927-4926-9319-0122e3d12451 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:52.848501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 189/391] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:52.850279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475140-e652-44b3-ae11-e9d35a7a2df8 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:52.851110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475140-e652-44b3-ae11-e9d35a7a2df8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:52.851397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475140-e652-44b3-ae11-e9d35a7a2df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:52.873059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-05475140-e652-44b3-ae11-e9d35a7a2df8 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:52.874632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-05475140-e652-44b3-ae11-e9d35a7a2df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:52.901509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:52.962034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 190/392] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:52.962220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813787e-a521-472b-8eab-1fd5d5476c6e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:52.962890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475140-e652-44b3-ae11-e9d35a7a2df8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.010077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.011152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.011816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.012103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/8888db000f97433e8f047879704f3916` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.015290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] RBAC: Authorizing `identity:create_grant(project_id=50358d273b27456a83e9a62e2a34ff3a, group_id=a5de327a0baf4e048e4d4264a4b556e4, role_id=8888db000f97433e8f047879704f3916)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:53.016805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:53.034253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 203/393] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 18 14:41:52 2022] PUT /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/8888db000f97433e8f047879704f3916 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:53.035025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.075305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475140-e652-44b3-ae11-e9d35a7a2df8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.093885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:53.116887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.118223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.118709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.119246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.120835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:53.122674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:53.125003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 191/394] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:52 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:53.130768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.176689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c9cc0-219d-4152-896b-063bb0215185 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.216376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:53.235850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.236721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.237016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.237299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.262252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:53.270330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:53.271268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:53.272075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 204/395] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:53.285983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.324886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f02d3-acf2-4111-9162-0f95a04fd09f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.398857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.399530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28ecc3-40f6-4b65-ac92-6f4034ba0fb3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.400305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.400825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.401348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.402846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:53.404620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:53.415684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 192/396] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:53 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:53.421815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.443176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.444638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.445130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.445417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.447556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:53.447870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:53.449279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:53.467236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 205/397] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:53.475309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.530003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:53.565926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:53.599902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394d1f4-9973-4281-b875-2d557aed8f8f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.629677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9195d6-e4a5-4cbd-aef7-b57d626c3a24 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.637147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.638048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.638332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.638607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.640855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3747467244a2087fc57f41a3d33b6, group_id=a5de327a0baf4e048e4d4264a4b556e4, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:53.642330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:53.657190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 193/398] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 18 14:41:53 2022] PUT /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:53.676740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.677780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.678063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.678386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.680380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:53.682117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:53.684229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 206/399] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:53 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:53.690100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.805407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350682-42f2-42f6-bea4-3f33b59a581f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.821389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:53.844897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e13d83-689f-45e7-82d2-1b0ea6b4c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:53.846306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13d83-689f-45e7-82d2-1b0ea6b4c680 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.846835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13d83-689f-45e7-82d2-1b0ea6b4c680 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.847698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13d83-689f-45e7-82d2-1b0ea6b4c680 None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.848919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13d83-689f-45e7-82d2-1b0ea6b4c680 None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:53.851249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13d83-689f-45e7-82d2-1b0ea6b4c680 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:53.853318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 194/400] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:53 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:53.858858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:53.971218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff033-8d6f-4c81-9b1c-7e690813c91d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:53.986542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:53.992473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef02041-c966-4012-a477-24514bb6873c None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:53.992781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef02041-c966-4012-a477-24514bb6873c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:53.993057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef02041-c966-4012-a477-24514bb6873c None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:53.994714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 195/401] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:54.001703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c98f-a1f9-4c0d-85b0-0a017f980e63 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.002600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c98f-a1f9-4c0d-85b0-0a017f980e63 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.002988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c98f-a1f9-4c0d-85b0-0a017f980e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.023259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a070c98f-a1f9-4c0d-85b0-0a017f980e63 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:54.024670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a070c98f-a1f9-4c0d-85b0-0a017f980e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:54.030808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.031710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.031998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.032279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.040025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=50358d273b27456a83e9a62e2a34ff3a, group_id=a5de327a0baf4e048e4d4264a4b556e4, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:54.041531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:54.061862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 207/402] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 18 14:41:53 2022] PUT /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:54.114162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 196/403] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:54.139821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.258158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9da19-3fd2-413a-89a4-77715d145eeb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:54.283120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1966e-0e94-483a-9eaf-b3ba74327253 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.283420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1966e-0e94-483a-9eaf-b3ba74327253 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.283687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1966e-0e94-483a-9eaf-b3ba74327253 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.285520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 197/404] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:54.291231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818553cf-ea6b-40bb-94b8-2d917ef5d109 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.292668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818553cf-ea6b-40bb-94b8-2d917ef5d109 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.292668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818553cf-ea6b-40bb-94b8-2d917ef5d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.302599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.303505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.304234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.304519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.309954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-818553cf-ea6b-40bb-94b8-2d917ef5d109 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:54.311370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-818553cf-ea6b-40bb-94b8-2d917ef5d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:54.316343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:54.324645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:54.325577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:54.326546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 208/405] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:54.331484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.375393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:54.399483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 198/406] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:54.421960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818553cf-ea6b-40bb-94b8-2d917ef5d109 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.453259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cd51a-01e0-495e-bcf2-a0419cee893c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:54.464771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:54.495054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.496190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.496677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.497259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.498278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:54.498781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:54.500523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:54.510027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 209/407] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:54.515689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.543518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818553cf-ea6b-40bb-94b8-2d917ef5d109 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:54.578132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.579031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.579385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.579732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.590970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:54.598916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:54.599802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:54.601496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 199/408] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:41:54.608622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.629450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:54.636816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee72241-2b27-45ca-bea6-0228012e2530 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:54.676762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.678260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.679002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.679818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.682594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:54.685438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:54.689130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 210/409] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:54.695144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.710619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:54.713573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9377-aa9f-4dcb-9ccf-fefb1987f360 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:54.749006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.749680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.749963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.750240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.750991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:54.751297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:54.752718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:54.761792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 200/410] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:54.767168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.809899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8cffb-df1c-43f6-be8d-1bcdd1619969 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:54.847628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.848904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.849404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.849976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.851694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:54.853470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:54.855772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 211/411] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:54.861377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.868857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22b5d-9a16-4fb8-bc6b-f7be5a4d03f8 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:54.896732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:54.903539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:54.904403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:54.904711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:54.905145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] PATH_INFO: `/v3/groups/4e0f516261a944ada9653d9380438119` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:54.906335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] RBAC: Authorizing `identity:get_group(group_id=4e0f516261a944ada9653d9380438119)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:54.907796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:54.909796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 201/412] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/groups/4e0f516261a944ada9653d9380438119 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:54.915109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:54.946479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:54.979655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8236b02-cd20-4750-92a3-024e41487e29 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:55.017045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:55.018461 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:55.018945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:55.019422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/8888db000f97433e8f047879704f3916` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:55.022089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3747467244a2087fc57f41a3d33b6, group_id=a5de327a0baf4e048e4d4264a4b556e4, role_id=8888db000f97433e8f047879704f3916)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:55.024302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:55.034587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114ee09-8d19-4ad7-b334-a4b05eff6c66 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:55.040645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 212/413] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 18 14:41:54 2022] PUT /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6/groups/a5de327a0baf4e048e4d4264a4b556e4/roles/8888db000f97433e8f047879704f3916 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:41:55.072404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d053e-e24b-4db1-9322-ebc33c77bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:55.073333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d053e-e24b-4db1-9322-ebc33c77bba3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:55.073615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d053e-e24b-4db1-9322-ebc33c77bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:55.073897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d053e-e24b-4db1-9322-ebc33c77bba3 None admin] PATH_INFO: `/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:55.075165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d053e-e24b-4db1-9322-ebc33c77bba3 None admin] RBAC: Authorizing `identity:get_project(project_id=0e866db7b1bd46b4b3abe110fcb71b70)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:55.076685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d053e-e24b-4db1-9322-ebc33c77bba3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:55.078767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 202/414] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:54 2022] GET /identity/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:55.084470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:55.204510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:55.216027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b62ff-fbcf-40c4-a7de-16a81fcbfddf None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:55.278252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff72d9-3309-490a-8aaf-fecbf7ed58ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:55.279496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff72d9-3309-490a-8aaf-fecbf7ed58ba None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:55.279966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff72d9-3309-490a-8aaf-fecbf7ed58ba None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:55.280423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff72d9-3309-490a-8aaf-fecbf7ed58ba None admin] PATH_INFO: `/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70/groups/4e0f516261a944ada9653d9380438119/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:55.282842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff72d9-3309-490a-8aaf-fecbf7ed58ba None admin] RBAC: Authorizing `identity:create_grant(project_id=0e866db7b1bd46b4b3abe110fcb71b70, group_id=4e0f516261a944ada9653d9380438119, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:55.284487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff72d9-3309-490a-8aaf-fecbf7ed58ba None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:55.304724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 213/415] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 18 14:41:55 2022] PUT /identity/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70/groups/4e0f516261a944ada9653d9380438119/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:41:55.821729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099564cd-d0ca-4d36-bed7-d5a28f657075 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:55.822106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099564cd-d0ca-4d36-bed7-d5a28f657075 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:55.822289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099564cd-d0ca-4d36-bed7-d5a28f657075 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:55.823912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 203/416] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:55.828910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee29c-bf03-4eb7-804b-146bdbf4a304 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:55.829208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee29c-bf03-4eb7-804b-146bdbf4a304 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:55.829495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee29c-bf03-4eb7-804b-146bdbf4a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:55.846619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-96fee29c-bf03-4eb7-804b-146bdbf4a304 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:55.847827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-96fee29c-bf03-4eb7-804b-146bdbf4a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:55.917651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 214/417] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:55.941636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099564cd-d0ca-4d36-bed7-d5a28f657075 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:56.081544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:56.087775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099564cd-d0ca-4d36-bed7-d5a28f657075 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:56.134465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:56.135339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:56.135628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:56.135908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:56.152362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:56.160928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:56.161830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:56.162628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 204/418] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:56.169009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee29c-bf03-4eb7-804b-146bdbf4a304 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:56.287046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:56.316701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee29c-bf03-4eb7-804b-146bdbf4a304 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:56.364575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:56.365179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:56.365466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:56.365745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:56.366549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:56.366857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:56.368227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:56.380978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 215/419] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:56.382702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:56.518271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0db6b-3c2b-40ca-99a1-f7ebdda4d275 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:56.563366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fec0bc-3ce9-4912-993f-c6ecd8205482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:56.564026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec0bc-3ce9-4912-993f-c6ecd8205482 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:56.564312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec0bc-3ce9-4912-993f-c6ecd8205482 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:56.564624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec0bc-3ce9-4912-993f-c6ecd8205482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:56.607409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:56.662854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fec0bc-3ce9-4912-993f-c6ecd8205482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:56.664343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fec0bc-3ce9-4912-993f-c6ecd8205482 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:56.796648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 205/420] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:56.801802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:56.963091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37802133-0ae6-46fb-9af2-be3966eb1da3 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:56.963611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37802133-0ae6-46fb-9af2-be3966eb1da3 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:56.963687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37802133-0ae6-46fb-9af2-be3966eb1da3 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:56.965260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 206/421] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:41:56.967235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daf8bf-e55b-4515-9d2e-4652e319fa71 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:56.982685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85c75d-5b03-494d-bf85-7110f3c56007 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:56.982995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85c75d-5b03-494d-bf85-7110f3c56007 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:56.983257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85c75d-5b03-494d-bf85-7110f3c56007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.001638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-3f85c75d-5b03-494d-bf85-7110f3c56007 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:57.002964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-3f85c75d-5b03-494d-bf85-7110f3c56007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:57.033800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.034664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.034947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.035225 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.037255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:57.039256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:57.044452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 216/422] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:56 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:57.047724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.078053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:57.103126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:57.129828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 207/423] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:57.170144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85c75d-5b03-494d-bf85-7110f3c56007 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.193604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a799cb-8c05-497b-ab81-852b114802fd None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:57.231107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e237561-2e0f-4632-b855-a6c2b6884688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.231978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237561-2e0f-4632-b855-a6c2b6884688 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.232361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237561-2e0f-4632-b855-a6c2b6884688 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.232679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e237561-2e0f-4632-b855-a6c2b6884688 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.233924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e237561-2e0f-4632-b855-a6c2b6884688 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:57.235623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e237561-2e0f-4632-b855-a6c2b6884688 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:57.237707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 217/424] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:57.239054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490fa0d-e7f1-42b2-b4f3-2462258b02bc None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.239441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490fa0d-e7f1-42b2-b4f3-2462258b02bc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.239730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490fa0d-e7f1-42b2-b4f3-2462258b02bc None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.241766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 218/425] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:57.244442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490fa0d-e7f1-42b2-b4f3-2462258b02bc None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.290606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85c75d-5b03-494d-bf85-7110f3c56007 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:57.325258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03494deb-2f06-4901-85e3-db54f878b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.326059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03494deb-2f06-4901-85e3-db54f878b052 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.326338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03494deb-2f06-4901-85e3-db54f878b052 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.326609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03494deb-2f06-4901-85e3-db54f878b052 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.335335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:57.337093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03494deb-2f06-4901-85e3-db54f878b052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-03494deb-2f06-4901-85e3-db54f878b052 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:57.344930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:57.345855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:57.346650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 208/426] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:57.347907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fca89-50cf-4d63-a6ad-26f35fd29b1c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.347907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fca89-50cf-4d63-a6ad-26f35fd29b1c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.348157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fca89-50cf-4d63-a6ad-26f35fd29b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.363217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490fa0d-e7f1-42b2-b4f3-2462258b02bc None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:57.367032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-134fca89-50cf-4d63-a6ad-26f35fd29b1c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:57.368197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-134fca89-50cf-4d63-a6ad-26f35fd29b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:57.401295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.402288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.402771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.403312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.404532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=8888db000f97433e8f047879704f3916, scope.project.id=50358d273b27456a83e9a62e2a34ff3a) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:57.405081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:57.406698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:57.414282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:57.414787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 219/427] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=8888db000f97433e8f047879704f3916 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:57.416507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.442545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 209/428] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:57.486295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fca89-50cf-4d63-a6ad-26f35fd29b1c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.532738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e4acb-3821-4c32-af9b-e16361e25dc7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:57.585292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.586384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.586870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.587402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.588499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] RBAC: Adding query filter params (name=member) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:57.589042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:57.590783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:57.601244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 220/429] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:57.613809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.623937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:57.641316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fca89-50cf-4d63-a6ad-26f35fd29b1c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:57.679451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.680527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.680984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.681399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.694600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:57.703394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:57.704360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 14:41:57.705287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:57.708159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 210/430] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:57.716141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.739585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75f5e-10eb-425c-ba45-5719d14c6ecc None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:57.778179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:57.781103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038956f-f5a5-4a76-b5fd-9bc05a1a4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.781973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038956f-f5a5-4a76-b5fd-9bc05a1a4da5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.782086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038956f-f5a5-4a76-b5fd-9bc05a1a4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.782367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038956f-f5a5-4a76-b5fd-9bc05a1a4da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.865635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038956f-f5a5-4a76-b5fd-9bc05a1a4da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:57.867059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8214d-a0ba-4d03-a611-adc361ff2165 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:57.867172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038956f-f5a5-4a76-b5fd-9bc05a1a4da5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:57.880986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:57.909756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02bec-52a0-4290-a9eb-508ffea8078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:57.910430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02bec-52a0-4290-a9eb-508ffea8078b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.910712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02bec-52a0-4290-a9eb-508ffea8078b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.910990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02bec-52a0-4290-a9eb-508ffea8078b None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.911730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02bec-52a0-4290-a9eb-508ffea8078b None admin] RBAC: Adding query filter params (name=member) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:57.912040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02bec-52a0-4290-a9eb-508ffea8078b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:57.913494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02bec-52a0-4290-a9eb-508ffea8078b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:57.922776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 211/431] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:57.924020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48b626-5cbd-444c-a410-e1b2765932c3 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.924303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48b626-5cbd-444c-a410-e1b2765932c3 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.924598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48b626-5cbd-444c-a410-e1b2765932c3 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:57.925980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 212/432] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:57.929671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48b626-5cbd-444c-a410-e1b2765932c3 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:57.994650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 221/433] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:57.994650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f999a8e-b9f0-4923-8bef-ff399641bafc None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:57.994650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f999a8e-b9f0-4923-8bef-ff399641bafc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:57.994650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f999a8e-b9f0-4923-8bef-ff399641bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.010185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4f999a8e-b9f0-4923-8bef-ff399641bafc None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:58.011577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4f999a8e-b9f0-4923-8bef-ff399641bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:58.039860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.045292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48b626-5cbd-444c-a410-e1b2765932c3 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.080255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.081226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.081334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 222/434] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:58.081413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.081484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.089474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f999a8e-b9f0-4923-8bef-ff399641bafc None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.127595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.160906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.162399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.201955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f999a8e-b9f0-4923-8bef-ff399641bafc None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.237756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.238621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.238909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.239182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.240544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.242571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.244280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 223/435] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:58.245124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.273881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.280932 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 213/436] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 14:41:58.281951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.348768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6286b-382e-4a24-aef0-a2f964b4c6fc None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.351024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.381340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050e6e4-4e86-4c31-8e00-45c3300adeb3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.383938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.384778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.385062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.385341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.395269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:58.403511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:58.404385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:41:58.405234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 224/437] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:58.405917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.416716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148f1f-5325-460a-b1b1-f6bf115d5485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.417570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148f1f-5325-460a-b1b1-f6bf115d5485 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.417844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148f1f-5325-460a-b1b1-f6bf115d5485 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.418366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148f1f-5325-460a-b1b1-f6bf115d5485 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.419533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33148f1f-5325-460a-b1b1-f6bf115d5485 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.421011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33148f1f-5325-460a-b1b1-f6bf115d5485 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.422593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 214/438] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:58.423732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a456aa-87b3-4754-963a-efb81a2f8799 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.424014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a456aa-87b3-4754-963a-efb81a2f8799 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.424292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a456aa-87b3-4754-963a-efb81a2f8799 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.425523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 215/439] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:41:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:41:58.426204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a456aa-87b3-4754-963a-efb81a2f8799 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.497725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.514572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aebb0-0ee3-48ea-90f8-e4db6721d712 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.531344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a456aa-87b3-4754-963a-efb81a2f8799 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.547436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.548289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.548658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.548880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] PATH_INFO: `/v3/projects/50358d273b27456a83e9a62e2a34ff3a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.550071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] RBAC: Authorizing `identity:get_project(project_id=50358d273b27456a83e9a62e2a34ff3a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.551503 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.553205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 225/440] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/projects/50358d273b27456a83e9a62e2a34ff3a => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:58.554601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.566139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70d104-292e-46fa-a6f7-2a21e66d29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.566806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70d104-292e-46fa-a6f7-2a21e66d29d9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.567088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70d104-292e-46fa-a6f7-2a21e66d29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.567363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70d104-292e-46fa-a6f7-2a21e66d29d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.568109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70d104-292e-46fa-a6f7-2a21e66d29d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:58.568418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70d104-292e-46fa-a6f7-2a21e66d29d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.569836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70d104-292e-46fa-a6f7-2a21e66d29d9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.577742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 216/441] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:58.578759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d9b7-2182-43be-ad8d-44615fb149b5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.579047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d9b7-2182-43be-ad8d-44615fb149b5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.579327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d9b7-2182-43be-ad8d-44615fb149b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.591308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.595538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f4e0d9b7-2182-43be-ad8d-44615fb149b5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:41:58.596784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f4e0d9b7-2182-43be-ad8d-44615fb149b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:41:58.660727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e34511-d0a4-454d-969c-16b0a7efd86f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.661619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 217/442] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:41:58.662445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d9b7-2182-43be-ad8d-44615fb149b5 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.695171 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.695826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.696114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.696394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.697293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=0ae3747467244a2087fc57f41a3d33b6) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:58.697612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.699031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.704687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 226/443] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:58.705457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.753715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.804252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d9b7-2182-43be-ad8d-44615fb149b5 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.814929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.822686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaae4da-41df-4775-a567-3ba23a9cb643 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.842805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.843718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.844001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.844278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.846056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.847158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.849021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 218/444] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:58.849728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:58.867027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.867723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.867983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.868259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:58.953155 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:58.954632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:58.963774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967cfe9-e800-4752-8b49-101193d5d009 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:58.989960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:58.998055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:58.998854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:58.999137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:58.999409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.009383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:41:59.017015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:41:59.017922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:41:59.018727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 219/445] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:41:59.019396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.052512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:59.059520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 227/446] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:59.060337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.117436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942ce16-9c2b-4443-90ef-a56db7e5e975 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.151185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.151834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.152115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.152403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.153269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=c906bb6cd0b942fb94f3f843cb8094e5, scope.project.id=50358d273b27456a83e9a62e2a34ff3a) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:59.153587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.155050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.155684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7f4e-e74b-4ffd-984a-e388c43dc541 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.160799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 220/447] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=50358d273b27456a83e9a62e2a34ff3a&role.id=c906bb6cd0b942fb94f3f843cb8094e5 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:59.161575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.194720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.195403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.195689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.195966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.196768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:59.197080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.198488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.213958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 228/448] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:59.216717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.238884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:59.283379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:59.293361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d34930-3b00-4ae7-b70c-b13fd837d3bc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.329918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.330543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c00f-7e0f-49f6-b7fe-80c53ce66315 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.330802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.331092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.331375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] PATH_INFO: `/v3/projects/0ae3747467244a2087fc57f41a3d33b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.332786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae3747467244a2087fc57f41a3d33b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.335706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.337689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 221/449] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/projects/0ae3747467244a2087fc57f41a3d33b6 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:59.344069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.374661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.375329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.375599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.375876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.463451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.463451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.463829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed204f-55e0-432d-8dc6-1db071eeff32 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.486306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:59.509224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.510127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.510410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.510686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] PATH_INFO: `/v3/groups/a5de327a0baf4e048e4d4264a4b556e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.511962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] RBAC: Authorizing `identity:get_group(group_id=a5de327a0baf4e048e4d4264a4b556e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.513689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.515899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 222/450] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/groups/a5de327a0baf4e048e4d4264a4b556e4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:59.521323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.536920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:59.579082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 229/451] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:41:59.584831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.643333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126384d-bfb8-4bea-9c7b-65724d0b1e0b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.681254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.681590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.681871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.682150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.682980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] RBAC: Adding query filter params (group.id=a5de327a0baf4e048e4d4264a4b556e4, role.id=8888db000f97433e8f047879704f3916, scope.project.id=0ae3747467244a2087fc57f41a3d33b6) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:41:59.683297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.687038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.692524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 223/452] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/role_assignments?group.id=a5de327a0baf4e048e4d4264a4b556e4&scope.project.id=0ae3747467244a2087fc57f41a3d33b6&role.id=8888db000f97433e8f047879704f3916 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:59.707669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb769-8489-4c15-88e9-899c0501c5f1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.755215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.756143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.756433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.757329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] PATH_INFO: `/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.759548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] RBAC: Authorizing `identity:get_project(project_id=0e866db7b1bd46b4b3abe110fcb71b70)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.761992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.764223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 230/453] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/projects/0e866db7b1bd46b4b3abe110fcb71b70 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:41:59.772114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.848384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:41:59.899658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47d04-3196-4d8d-83ff-fe219e635aad None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:41:59.933547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7f04-ebbd-4138-af1a-08443a70fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:41:59.934407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7f04-ebbd-4138-af1a-08443a70fd12 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:41:59.934690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7f04-ebbd-4138-af1a-08443a70fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:41:59.934969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7f04-ebbd-4138-af1a-08443a70fd12 None admin] PATH_INFO: `/v3/groups/4e0f516261a944ada9653d9380438119` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:41:59.936150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d7f04-ebbd-4138-af1a-08443a70fd12 None admin] RBAC: Authorizing `identity:get_group(group_id=4e0f516261a944ada9653d9380438119)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:41:59.937635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d7f04-ebbd-4138-af1a-08443a70fd12 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:41:59.939635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 224/454] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/groups/4e0f516261a944ada9653d9380438119 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:41:59.946531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:41:59.975373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:00.050757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1141ef-ff8c-44d5-8db8-76af0232951f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:00.084489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274bcd-1d58-45ce-9b06-4a715bd1e257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:00.085276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274bcd-1d58-45ce-9b06-4a715bd1e257 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:00.085565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274bcd-1d58-45ce-9b06-4a715bd1e257 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:00.085848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274bcd-1d58-45ce-9b06-4a715bd1e257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:00.086680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19274bcd-1d58-45ce-9b06-4a715bd1e257 None admin] RBAC: Adding query filter params (group.id=4e0f516261a944ada9653d9380438119, role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=0e866db7b1bd46b4b3abe110fcb71b70) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:00.086999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19274bcd-1d58-45ce-9b06-4a715bd1e257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:00.088433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19274bcd-1d58-45ce-9b06-4a715bd1e257 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:00.094153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 231/455] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 18 14:41:59 2022] GET /identity/v3/role_assignments?group.id=4e0f516261a944ada9653d9380438119&scope.project.id=0e866db7b1bd46b4b3abe110fcb71b70&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:02.895180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecba35-2bb9-4f0e-9f57-a44555fe4564 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:02.896276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecba35-2bb9-4f0e-9f57-a44555fe4564 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:02.896843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecba35-2bb9-4f0e-9f57-a44555fe4564 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:02.898918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 225/456] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:02.904644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ed7f8-3822-4ae3-8fcd-c612fdfe02b0 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:02.905616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ed7f8-3822-4ae3-8fcd-c612fdfe02b0 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:02.906101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ed7f8-3822-4ae3-8fcd-c612fdfe02b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:02.929885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5b2ed7f8-3822-4ae3-8fcd-c612fdfe02b0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:02.931430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5b2ed7f8-3822-4ae3-8fcd-c612fdfe02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:02.986868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982f91-cf39-41c4-a9d2-ece31cc59168 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:02.987517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982f91-cf39-41c4-a9d2-ece31cc59168 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:02.987928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a982f91-cf39-41c4-a9d2-ece31cc59168 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:02.989671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 226/457] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:03.003447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb06c-3bcd-4a65-8d06-85c252876c15 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.004055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb06c-3bcd-4a65-8d06-85c252876c15 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.004772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb06c-3bcd-4a65-8d06-85c252876c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.015664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 232/458] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:03.037633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f5ebb06c-3bcd-4a65-8d06-85c252876c15 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:03.039674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f5ebb06c-3bcd-4a65-8d06-85c252876c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:03.039802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ed7f8-3822-4ae3-8fcd-c612fdfe02b0 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.080946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:03.121988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 227/459] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:42:03.123538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc5cf-6e53-4426-afb3-2e64911274ca None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.123999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc5cf-6e53-4426-afb3-2e64911274ca None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.124439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc5cf-6e53-4426-afb3-2e64911274ca None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.126200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 228/460] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:03.137983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e80fb-c517-4cdb-87b0-7e15a0d0fc15 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.138549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e80fb-c517-4cdb-87b0-7e15a0d0fc15 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.138994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e80fb-c517-4cdb-87b0-7e15a0d0fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.165640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ea8e80fb-c517-4cdb-87b0-7e15a0d0fc15 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:03.167172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ea8e80fb-c517-4cdb-87b0-7e15a0d0fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:03.176720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ed7f8-3822-4ae3-8fcd-c612fdfe02b0 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:03.220991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:03.222162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.223393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.223824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.236351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:03.236899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:03.239166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:03.261312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 229/461] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:03.264526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e80fb-c517-4cdb-87b0-7e15a0d0fc15 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:03.265353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:03.266417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:03.267487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:03.267487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:03.267487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:03.267487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:03.269142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 233/462] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:03.275441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.370824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:03.384349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e80fb-c517-4cdb-87b0-7e15a0d0fc15 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:03.407034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9af9b4-d02c-46c1-a78c-d85071313d23 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:03.421517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:03.422617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.423100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.423673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.435458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:03.437354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:03.447950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:03.448641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.448932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.449209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.449932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:03.450237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:03.451589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:03.458210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:03.459118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:03.460521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:03.460521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:03.460521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:03.460521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:03.462820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 230/463] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:03.463806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.465577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 234/464] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:03.469960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.500501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:03.571689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eb930-c359-438a-9b0c-b6c1cb8ebd2b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:03.576669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d24d-dcf4-4f98-b29d-0e16fd12f024 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:03.607464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:03.608259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.608548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.608874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.612361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:03.618428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b09b8-99ec-41ef-b611-6291b046f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:03.619294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b09b8-99ec-41ef-b611-6291b046f8bb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.619654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:03.619964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b09b8-99ec-41ef-b611-6291b046f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.620411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b09b8-99ec-41ef-b611-6291b046f8bb None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.621171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:03.621583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b09b8-99ec-41ef-b611-6291b046f8bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:03.622135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b09b8-99ec-41ef-b611-6291b046f8bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:03.623682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b09b8-99ec-41ef-b611-6291b046f8bb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:03.635917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 235/465] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:03.637224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12885bf8-d8ae-4859-abd5-ece192a3f829 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.637516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12885bf8-d8ae-4859-abd5-ece192a3f829 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.637798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12885bf8-d8ae-4859-abd5-ece192a3f829 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.639148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 236/466] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:03.639699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12885bf8-d8ae-4859-abd5-ece192a3f829 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:03.645617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:03.646486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:03.647883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:03.647883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:03.647883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:03.647883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:03.647883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 231/467] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:03.648642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.742219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:03.753339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12885bf8-d8ae-4859-abd5-ece192a3f829 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:03.759946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e7403-24eb-400f-b927-7b8779907fd3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:03.787398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c050b-e049-43df-8880-aca50b41d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:03.788736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c050b-e049-43df-8880-aca50b41d0ef None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.789023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c050b-e049-43df-8880-aca50b41d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.789302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c050b-e049-43df-8880-aca50b41d0ef None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.790017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c050b-e049-43df-8880-aca50b41d0ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:03.791454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c050b-e049-43df-8880-aca50b41d0ef None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:03.799527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:03.800491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.800951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.801412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.802445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:03.804172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:03.812643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 237/468] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:42:03 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:03.814100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ab0b-d1d2-48a3-9b6b-09626c9e87ba None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:03.814369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ab0b-d1d2-48a3-9b6b-09626c9e87ba None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:03.814652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ab0b-d1d2-48a3-9b6b-09626c9e87ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:03.848622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 232/469] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:42:03 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:03.848622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:03.850946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-bf38ab0b-d1d2-48a3-9b6b-09626c9e87ba None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:03.852604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bf38ab0b-d1d2-48a3-9b6b-09626c9e87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:03.986736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:04.040309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cbcc-2f5a-4a6a-9956-57053d9dc96a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:04.086487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 238/470] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:04.107468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:04.108634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.109169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.109692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.111120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:04.111701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:04.113167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ab0b-d1d2-48a3-9b6b-09626c9e87ba None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:04.114357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:04.140969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:04.148049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 233/471] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:04.156171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:04.255635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ab0b-d1d2-48a3-9b6b-09626c9e87ba None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:04.294458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a277-3e47-4bcb-893f-16fcfaa657ec None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:04.301419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:04.302296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.302579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.302855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.325121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:04.326611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:04.340426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:04.341152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.341442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.341724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.343094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:04.344726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:04.363734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:04.364691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:04.366627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:04.366627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:04.366627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:04.366627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:04.366627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 239/472] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:04.371315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:04.386008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 234/473] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:42:04 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:42:04.417147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:04.497846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b725d-73f7-4916-81a3-515dc4cfcebe None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:04.535943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558e83-a1e4-43c7-9645-3725cf5aa47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:04.536646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558e83-a1e4-43c7-9645-3725cf5aa47f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.536940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558e83-a1e4-43c7-9645-3725cf5aa47f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.537219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558e83-a1e4-43c7-9645-3725cf5aa47f None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.538518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558e83-a1e4-43c7-9645-3725cf5aa47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:04.538831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558e83-a1e4-43c7-9645-3725cf5aa47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:04.540334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558e83-a1e4-43c7-9645-3725cf5aa47f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:04.553878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 240/474] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:04.561961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:04.586662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14c43d-7c61-4b4b-9fc2-18ff38322a8e None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.587029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14c43d-7c61-4b4b-9fc2-18ff38322a8e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.587233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14c43d-7c61-4b4b-9fc2-18ff38322a8e None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.588854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 241/475] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:04.594436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dcbdb-0739-4e05-9852-104229c25c4c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.594801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dcbdb-0739-4e05-9852-104229c25c4c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.595003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dcbdb-0739-4e05-9852-104229c25c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.626475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-bb9dcbdb-0739-4e05-9852-104229c25c4c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:04.627713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bb9dcbdb-0739-4e05-9852-104229c25c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:04.670518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:04.723192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890d48-b45a-4ecd-a279-25c2e928eb83 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:04.743733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 242/476] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:42:04.768606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:04.768606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.768606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.768606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.769108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:04.769108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:04.773388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dcbdb-0739-4e05-9852-104229c25c4c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:04.797872 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 235/477] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:42:04 2022] POST /identity/v3/users => generated 249 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:04.799674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:04.902568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dcbdb-0739-4e05-9852-104229c25c4c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:04.944783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:04.945518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:04.945824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:04.946124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:04.946898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:04.948340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:04.958334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.sql.core [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 14:42:04.958334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 14:42:04.958334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [parameters: {'id': '93716cc2c97341bca6b6371c804f1973', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 14:42:04.958334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86727) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result = self._query(query) May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application conn.query(q) May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result.read() May 18 14:42:04.978395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return ref.to_dict() May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 14:42:04.979914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application next(self.gen) May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application yield resource May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application next(self.gen) May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.session.rollback() May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.force_reraise() May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise self.value May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application session.commit() May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 14:42:04.981522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._prepare_impl() May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.session.flush() May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._flush(objects) May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application compat.raise_( May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application flush_context.execute() May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rec.execute(self) May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 14:42:04.982941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 14:42:04.983830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result = self._query(query) May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application conn.query(q) May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result.read() May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 14:42:04.990491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [parameters: {'id': '93716cc2c97341bca6b6371c804f1973', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:04.993325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 14:42:04.995258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:04.997249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 243/478] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 18 14:42:04 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:05.000823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:05.120774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b9724-859b-4c93-bf39-0e5f1ba200c5 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:05.134467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:05.158732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0188243-b3fa-419e-acee-04ec5385a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:05.159486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0188243-b3fa-419e-acee-04ec5385a85f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:05.159772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0188243-b3fa-419e-acee-04ec5385a85f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:05.160106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0188243-b3fa-419e-acee-04ec5385a85f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:05.170644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0188243-b3fa-419e-acee-04ec5385a85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-c0188243-b3fa-419e-acee-04ec5385a85f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:05.180043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:05.180961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:05.181775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 236/479] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:05.188400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:05.288870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:05.306069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5af387-8559-4507-ba68-4fe372acb38c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:05.341418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a579a1-b1f4-4e17-8ddf-7d4552a17f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:05.342095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a579a1-b1f4-4e17-8ddf-7d4552a17f2b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:05.342389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a579a1-b1f4-4e17-8ddf-7d4552a17f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:05.342673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a579a1-b1f4-4e17-8ddf-7d4552a17f2b None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:05.343427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a579a1-b1f4-4e17-8ddf-7d4552a17f2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:05.343749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a579a1-b1f4-4e17-8ddf-7d4552a17f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:05.345165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a579a1-b1f4-4e17-8ddf-7d4552a17f2b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:05.354545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 244/480] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:06.607565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d33131-3573-403d-a0c5-0de3015212fb None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:06.608505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d33131-3573-403d-a0c5-0de3015212fb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:06.609024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d33131-3573-403d-a0c5-0de3015212fb None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:06.610718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 237/481] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:06.616493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eedd43-6e9d-4a71-a7d7-41f531cf4919 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:06.617333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eedd43-6e9d-4a71-a7d7-41f531cf4919 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:06.617818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eedd43-6e9d-4a71-a7d7-41f531cf4919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:06.641814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f2eedd43-6e9d-4a71-a7d7-41f531cf4919 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:06.643385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f2eedd43-6e9d-4a71-a7d7-41f531cf4919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:06.732056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 245/482] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:06.768038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d33131-3573-403d-a0c5-0de3015212fb None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:06.796355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f14a0-1678-4d34-b289-6ab9a4fcd58c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:06.796992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f14a0-1678-4d34-b289-6ab9a4fcd58c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:06.797498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f14a0-1678-4d34-b289-6ab9a4fcd58c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:06.799071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 246/483] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:06.804879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d8cb2-f7dc-4d9d-becc-533163915231 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:06.805171 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d8cb2-f7dc-4d9d-becc-533163915231 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:06.805454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d8cb2-f7dc-4d9d-becc-533163915231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:06.830121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e98d8cb2-f7dc-4d9d-becc-533163915231 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:06.831329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e98d8cb2-f7dc-4d9d-becc-533163915231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:06.947515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 247/484] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 18 14:42:06.965813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d33131-3573-403d-a0c5-0de3015212fb None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:06.973657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d8cb2-f7dc-4d9d-becc-533163915231 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:06.982582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:07.037273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.038616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.038904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.039186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.059539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:07.074281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:07.075249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:07.076716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 238/485] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:07.081101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.132192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:07.170870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d8cb2-f7dc-4d9d-becc-533163915231 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:07.237832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86dc00-ca8d-43fc-8646-2609885d61ba None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:07.259529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.260867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.262194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.263366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.284213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:07.305135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:07.306321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:07.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:07.310873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 248/486] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:07.313061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.313904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.314421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.314844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.315841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:07.316855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.317318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:07.318891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:07.338449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 239/487] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:07.345550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.419752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:07.463690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7369d-1501-41f6-b71d-d4d4fd1efab5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:07.480909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:07.492429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184c4ba-d2bf-4a8c-9a9c-33cd0f92d033 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:07.500552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0169f-85f1-4031-9a56-233517cfa9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.501327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0169f-85f1-4031-9a56-233517cfa9bc None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.501549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0169f-85f1-4031-9a56-233517cfa9bc None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.501831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0169f-85f1-4031-9a56-233517cfa9bc None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.502635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0169f-85f1-4031-9a56-233517cfa9bc None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:07.502984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0169f-85f1-4031-9a56-233517cfa9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:07.504365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0169f-85f1-4031-9a56-233517cfa9bc None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:07.517249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 249/488] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:07.518555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3480e-574c-4f9f-b4b7-9d519df50155 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.518851 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3480e-574c-4f9f-b4b7-9d519df50155 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.519195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3480e-574c-4f9f-b4b7-9d519df50155 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.520475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 250/489] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:07.525825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3480e-574c-4f9f-b4b7-9d519df50155 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.534079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372389c4-9647-4f00-9a79-c6b94b3230d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.535592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372389c4-9647-4f00-9a79-c6b94b3230d8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.536030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372389c4-9647-4f00-9a79-c6b94b3230d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.536479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372389c4-9647-4f00-9a79-c6b94b3230d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.553869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372389c4-9647-4f00-9a79-c6b94b3230d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:07.556496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372389c4-9647-4f00-9a79-c6b94b3230d8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-372389c4-9647-4f00-9a79-c6b94b3230d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:07.583247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:07.584358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:07.586062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:07.586062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:07.586062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:07.586062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:07.588730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 240/490] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:07.590375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa848b8-5a39-4918-a1df-5312c2207fc8 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.590828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa848b8-5a39-4918-a1df-5312c2207fc8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.591858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa848b8-5a39-4918-a1df-5312c2207fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.611455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-6aa848b8-5a39-4918-a1df-5312c2207fc8 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:07.612812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6aa848b8-5a39-4918-a1df-5312c2207fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:07.661485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3480e-574c-4f9f-b4b7-9d519df50155 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:07.688924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 241/491] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:07.690089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa848b8-5a39-4918-a1df-5312c2207fc8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.697372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:07.708840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.710393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.710826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.711247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.724890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:07.726877 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:07.750586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:07.751491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:07.752440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:07.752440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:07.752440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:07.752440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:07.752440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 251/492] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:07.753318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.794663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:07.819490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa848b8-5a39-4918-a1df-5312c2207fc8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:07.858815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943311b-7d9a-42c5-a5d1-35324ab4fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.859516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943311b-7d9a-42c5-a5d1-35324ab4fd44 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.859766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943311b-7d9a-42c5-a5d1-35324ab4fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.860044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943311b-7d9a-42c5-a5d1-35324ab4fd44 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.860800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943311b-7d9a-42c5-a5d1-35324ab4fd44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:07.861111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943311b-7d9a-42c5-a5d1-35324ab4fd44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:07.861337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890d886-91c5-441a-8e14-6549be47568f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:07.862613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943311b-7d9a-42c5-a5d1-35324ab4fd44 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:07.878890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 242/493] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:07.878890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eb40e-c25d-4932-a1e6-1845ea1f7d1b None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.878890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eb40e-c25d-4932-a1e6-1845ea1f7d1b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.878890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eb40e-c25d-4932-a1e6-1845ea1f7d1b None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.878890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 243/494] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:07.878890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eb40e-c25d-4932-a1e6-1845ea1f7d1b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.906933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:07.907734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:07.908020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:07.908306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:07.919132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:07.927028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:07.927971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:07.929388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:07.933505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 252/495] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:07.934346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:07.980707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:07.995690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eb40e-c25d-4932-a1e6-1845ea1f7d1b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.031446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f0169-c777-449a-b001-02835a9a0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.032574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0169-c777-449a-b001-02835a9a0075 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.032897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0169-c777-449a-b001-02835a9a0075 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.033229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0169-c777-449a-b001-02835a9a0075 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.033958 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f0169-c777-449a-b001-02835a9a0075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:08.034275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f0169-c777-449a-b001-02835a9a0075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.035919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f0169-c777-449a-b001-02835a9a0075 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.039081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.044558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53f2b-a370-4a7f-b0ff-e7ffd59abf34 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.055846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 244/496] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:08.055846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91fe17-5a9d-463a-acef-b5c74d61908f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.055846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91fe17-5a9d-463a-acef-b5c74d61908f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.055846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91fe17-5a9d-463a-acef-b5c74d61908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.072978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ce91fe17-5a9d-463a-acef-b5c74d61908f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:08.074325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ce91fe17-5a9d-463a-acef-b5c74d61908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:08.086230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.087292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.087583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.087905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] PATH_INFO: `/v3/users/glance` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.097598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.099097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:08.117699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:08.118657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 14:42:08.119572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:08.123504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 253/497] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:08.124230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.156618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 245/498] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:08.156618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91fe17-5a9d-463a-acef-b5c74d61908f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.235182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.237912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0812dca-00f1-459c-ac25-4f08e8b6386d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.276198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91fe17-5a9d-463a-acef-b5c74d61908f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.279736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.280406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.280731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.281017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.281822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:08.282089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.283476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.292087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 254/499] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:08.292902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.304397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.313594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.314384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.314662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.314934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.321913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.323367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:08.338608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:08.339507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 246/500] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:08.340713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.395443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a55f8-6f84-48d4-a7bb-f071d3b2424a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.429145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517884e8-a35e-43aa-9fa7-af9e0c520945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.429810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517884e8-a35e-43aa-9fa7-af9e0c520945 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.430099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517884e8-a35e-43aa-9fa7-af9e0c520945 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.430377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517884e8-a35e-43aa-9fa7-af9e0c520945 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.431210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517884e8-a35e-43aa-9fa7-af9e0c520945 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:08.431530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517884e8-a35e-43aa-9fa7-af9e0c520945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.432994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517884e8-a35e-43aa-9fa7-af9e0c520945 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.436056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525185f-2d1c-491b-b3b2-d50eca1c404f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.468805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.469547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 255/501] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:08.469671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.469852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.470128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.470827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004014-bc31-4f37-9586-0e87f1240734 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.471123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004014-bc31-4f37-9586-0e87f1240734 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.471406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004014-bc31-4f37-9586-0e87f1240734 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.472655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 256/502] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:08.473361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004014-bc31-4f37-9586-0e87f1240734 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.483784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:08.492327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:08.493371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:08.494175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 247/503] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:08.495272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.497563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.543880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.574040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004014-bc31-4f37-9586-0e87f1240734 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.596457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893fa10-9861-4ac8-946a-a0dc80535f3e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.607151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.607949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.608232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.608513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.619218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.620710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.630065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c7396-115d-4adf-a431-d348f87d3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.630735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c7396-115d-4adf-a431-d348f87d3536 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.631020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c7396-115d-4adf-a431-d348f87d3536 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.631307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c7396-115d-4adf-a431-d348f87d3536 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.632169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c7396-115d-4adf-a431-d348f87d3536 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:08.632487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c7396-115d-4adf-a431-d348f87d3536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.633970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c7396-115d-4adf-a431-d348f87d3536 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:08.637896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:08.638901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:08.639781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:08.639781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:08.639781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:08.639781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:08.640714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 257/504] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:08.641753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.671203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 248/505] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:08.672466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6c666-8479-4f9b-be28-f93c39df17c7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.672801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6c666-8479-4f9b-be28-f93c39df17c7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.673085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6c666-8479-4f9b-be28-f93c39df17c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.689561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b0f6c666-8479-4f9b-be28-f93c39df17c7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:08.690755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b0f6c666-8479-4f9b-be28-f93c39df17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:08.710619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.744047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6026eff-ef54-4e10-ac3d-8c952d3cc3bd None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.767708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 249/506] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:08.768611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6c666-8479-4f9b-be28-f93c39df17c7 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.782145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.783022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.783532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.783958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.808052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.855238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.856724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.872636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6c666-8479-4f9b-be28-f93c39df17c7 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:08.905822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:08.906485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:08.906769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:08.907049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:08.907817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:08.908098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:08.909516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:08.917962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 250/507] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:08.919126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:08.923943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:08.955489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 258/508] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:08.956566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.016621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.023694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcab10-e365-48a9-ab8a-c4d5476fbae2 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.057429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.058157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.058374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.058652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.059365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:09.059673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.061106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.062083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be769deb-f5a1-43fa-91c0-d3f8ec8bdbec None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.073303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 251/509] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:09.074414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.102927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.103583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.105106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.105430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.149972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.176717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.178202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.182361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c98e2d-2389-4739-98da-1a0bd46ffa60 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.217489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.218298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.218583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.218868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.228895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.230363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:09.247720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:09.248759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:09.254711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:09.254711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:09.254711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.254711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:09.254711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 252/510] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:09.254711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.263121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.278725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 259/511] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:09.279571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.349439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.355745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f28959-913e-4c6f-bf83-6264cf513a22 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.378910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368a6c-1fb3-4b37-b0f7-2bc43c3d59aa None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.390267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.391142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.391429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.391702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.403003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.404490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.413537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.414331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.414618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.414899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:09.422600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:09.423520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:09.424380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:09.424380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:09.424380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.424380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:09.424380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 253/512] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:09.424689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.430047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.431488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:09.449520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:09.450360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:09.451213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:09.451213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:09.451213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.451213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:09.451213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 260/513] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:09.451475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.483815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.524470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe5e6-fef2-4f66-9b59-9bbd913c2150 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.551569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9e3f5-b505-49bf-91cb-9dec2354ced1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.558021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.558816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.559102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.559379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.566738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.568209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.575224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:09.582868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:09.583959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 254/514] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:09.585202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.591367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.592096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.592389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.592701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.593428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:09.593742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.595109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.606546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 261/515] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:09.607490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.691101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde24d-947a-4a4c-bb92-8cffce272574 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.705319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cff92e-76d2-4354-80f9-8c57fd3fc4ad None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.710884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.725342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.726142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.726431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.726717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.737132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.738603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.739874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.740540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.741379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.741674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.742397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:09.742710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.744070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.755685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 262/516] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:09.756355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:09.758120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:09.759490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:09.759490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:09.759490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:09.759490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:09.759703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.759772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 255/517] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:09.759772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.807156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:09.858174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66132028-b789-469c-a05f-3b5629bbbc9b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.858959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911420b-20b4-477f-ab52-6a8237dbb46d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:09.890383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.891046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.891331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.891609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.892435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:09.892772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.892933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:09.893594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:09.893882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:09.894166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:09.894272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.894886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:09.895198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:09.897524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:09.908520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 263/518] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:09.909719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.912523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 256/519] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:09.914048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:09.944100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.012512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ace9-0279-443f-9b95-f8f95f172b89 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.013191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659836-5633-4088-8565-d472d4ddddbf None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.015442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.046437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.047097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.047380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.047658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.048122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.048374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:10.048708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.048842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.049127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.049407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.050093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.050197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.051603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.061096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 257/520] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:10.061877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.076447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 264/521] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:42:09 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:10.077388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.179486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.189703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d115f73-ba9b-4fcc-9157-9c2babea1ac9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.193086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203469-8bb1-4623-b799-427bbfb18421 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.228410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.229262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.229549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.229834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.233748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.234899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.235392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.235842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.237718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.239225 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.245353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.247126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:10.256157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:10.258643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 265/522] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:10.259518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:10.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:10.264176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:10.265154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 258/523] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:10.265721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.284643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.376260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc435-daa1-4454-851f-83003079a445 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.386930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fb2e9-f550-4af6-a338-37280fa696e0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.410919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.411567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.411854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.412135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.424171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.425132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.425401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.425680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.432956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.434537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:10.450097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:10.450951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:10.451785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:10.456059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 259/524] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:10.456700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.469279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.485511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.487229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.509254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.556917 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7cfeb-3c85-4ff3-b189-5d31760f4eb7 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.591367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.592036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.592325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.592628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.593419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:10.593734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.595190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.596392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 266/525] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:10.597538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.617432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 260/526] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:10.618527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.693094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.715270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d98b-fa41-4090-96e0-49ba494fb68f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.725466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0c2cf-08ff-4e7b-bb3d-5e98216a2c1a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.736993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.753554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.754190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.754481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.754785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.755600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:10.755917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.757972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.760626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.761284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.761565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.761839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.762613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:10.762921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.764340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.784625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 261/527] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:10.784807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 267/528] 10.222.0.59 () {56 vars in 1139 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:10.784900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.785018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.891598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f48c8-91bd-4d2f-b229-fbae27e49062 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.894169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c5f35-f1b8-47d3-a0b9-9371766caaa6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:10.921487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:10.929023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.930088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.930581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.931057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.931299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:10.931972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:10.932240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:10.932536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:10.933395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=420ae644ec5548fbbde64ffa63c868ca) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:10.933712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.935305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.940869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 268/529] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/role_assignments?user.id=420ae644ec5548fbbde64ffa63c868ca&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:10.941666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:10.946714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:10.948321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:10.982132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:10.983110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:10.983972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:10.983972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:10.983972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:10.983972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:10.987937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 262/530] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:10.989299 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:11.014056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:11.077923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69019d04-60ff-43c0-bca4-c1786cfc4cf3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:11.103684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f13e8-7668-4498-93dd-729a04c2d877 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:11.118004 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:11.119039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:11.119517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:11.119989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:11.148878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:11.149881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:11.150379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:11.150847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:11.151864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=06274e1b42f6471cac81889ec673a222) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:11.152369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:11.154044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:11.160997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 263/531] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/role_assignments?user.id=06274e1b42f6471cac81889ec673a222&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:11.162216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:11.203638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:11.205119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:11.224025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:11.282198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:11.312331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9629f-f3a7-465a-9e28-f844c735d309 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:11.385496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 269/532] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:11.390937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:11.391299 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:11.391992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:11.392276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:11.392557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:11.393531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:11.393852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:11.397638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:11.414399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 264/533] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:11.422969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:11.515103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2859-928a-4517-ab4e-4e2855bb3c1f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:11.555329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:11.556189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:11.556478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:11.556803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:11.568151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:11.570019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:11.571927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:11.590526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:11.591430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:11.593047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:11.593047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:11.593047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:11.593047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:11.593047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 270/534] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:11.597735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:11.671366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ed3ee-f66d-4eae-b5fa-1bb5908a87c4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:11.683679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:11.714167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348902a6-0fb3-4ef7-96cb-b1ed56075607 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:11.755800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:11.757398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:11.757885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:11.758375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:11.760336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:11.761046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:11.761516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:11.761803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:11.763165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:11.763489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:11.764946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:11.774055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:11.775842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:11.790903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 271/535] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:11.796820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:11.802686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:11.803600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:11.804544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:11.812256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 265/536] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:11.821327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:11.901189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:11.981957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00ca28-3109-4f85-91eb-e89956998ad9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:12.017952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:12.018761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.019047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.019329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.023292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec499c-a73a-4ad1-81ec-5aca023a240d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:12.027731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:12.030440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:12.047132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:12.048043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:12.048952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 272/537] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:12.056711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:12.098520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:12.099200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.099484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.099760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.100615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:12.100933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:12.102405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:12.136723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 266/538] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:12.140029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:12.191687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:12.250416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181c81-a51d-454e-88f7-24f4bb86d360 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:12.272752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:12.312806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:12.313416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.313702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.314241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.315068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:12.315388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:12.316907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:12.321455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898357c-7326-4565-96b0-2b90c113d085 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:12.360652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 273/539] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:12.367767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:12.389548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904b155-7da9-468f-850d-5d9b7d6b0e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:12.390222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904b155-7da9-468f-850d-5d9b7d6b0e32 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.390508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904b155-7da9-468f-850d-5d9b7d6b0e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.390788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904b155-7da9-468f-850d-5d9b7d6b0e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.392045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904b155-7da9-468f-850d-5d9b7d6b0e32 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=6b2524791e2943c2a1eeae24e17c4f34) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:12.392369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904b155-7da9-468f-850d-5d9b7d6b0e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:12.393873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904b155-7da9-468f-850d-5d9b7d6b0e32 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:12.409704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 267/540] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:12 2022] GET /identity/v3/role_assignments?user.id=6b2524791e2943c2a1eeae24e17c4f34&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:12.503944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5332b-f056-49e6-ab1a-d64f048e6578 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.504310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5332b-f056-49e6-ab1a-d64f048e6578 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.504512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5332b-f056-49e6-ab1a-d64f048e6578 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.506252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 268/541] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:12.512807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97b6e-b42b-4958-ac7e-4bf39c537a35 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.513097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97b6e-b42b-4958-ac7e-4bf39c537a35 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.513377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97b6e-b42b-4958-ac7e-4bf39c537a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.526389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8006360-5984-439f-980e-e0adb8216e75 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:12.532151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-dae97b6e-b42b-4958-ac7e-4bf39c537a35 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:12.533426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dae97b6e-b42b-4958-ac7e-4bf39c537a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:12.612683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:12.614197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.616240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.618337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.619489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=1aa975bb70624500aa802e7a708014c2) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:12.621908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:12.629065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:12.639205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 274/542] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:12 2022] GET /identity/v3/role_assignments?user.id=1aa975bb70624500aa802e7a708014c2&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:12.668099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 269/543] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:42:12.693281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:12.739784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:12.823570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3088-13fd-4592-abe9-d78fefc669ec None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:12.860863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:12.861731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:12.862020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:12.862299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:12.873653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:12.882183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:12.883786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:12.884613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 275/544] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:12.891335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae97b6e-b42b-4958-ac7e-4bf39c537a35 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:12.912503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:13.019975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae97b6e-b42b-4958-ac7e-4bf39c537a35 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:13.066576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:13.067255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:13.067537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:13.067815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:13.068564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:13.069470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:13.070938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:13.079349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 270/545] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:13.085737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:13.221030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:13.225193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edfb8a-a511-4a0d-83fb-44e25cd91607 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:13.273613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:13.274470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:13.274758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:13.275038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:13.290495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:13.291950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:13.313210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:13.314106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:13.314954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:13.314954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:13.314954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:13.314954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:13.319525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 276/546] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:13.320893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:13.431910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:13.454653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d45b2-30e2-403a-83fd-162d9de4ef5d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:13.495373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:13.496037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:13.496326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:13.496621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:13.497464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:13.497776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:13.499199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:13.523195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 271/547] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:13.528967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:13.660480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81dd4-b8b7-4fab-bfae-54a56a930be8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:13.706637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bf209-931b-412a-ae46-94894d0918ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:13.707445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bf209-931b-412a-ae46-94894d0918ad None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:13.707731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bf209-931b-412a-ae46-94894d0918ad None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:13.708013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bf209-931b-412a-ae46-94894d0918ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:13.715883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bf209-931b-412a-ae46-94894d0918ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:13.717378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bf209-931b-412a-ae46-94894d0918ad None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-953bf209-931b-412a-ae46-94894d0918ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:13.731964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:13.733426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:13.734510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 277/548] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:13.742712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:13.752097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f2f86-44b0-4f37-aa40-6a8bbfdec52e None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:13.752323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f2f86-44b0-4f37-aa40-6a8bbfdec52e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:13.752608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f2f86-44b0-4f37-aa40-6a8bbfdec52e None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:13.756091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 278/549] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:13.760993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b516eb4-114f-45f2-a2f4-397a8a5ddb82 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:13.761291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b516eb4-114f-45f2-a2f4-397a8a5ddb82 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:13.761573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b516eb4-114f-45f2-a2f4-397a8a5ddb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:13.788929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4b516eb4-114f-45f2-a2f4-397a8a5ddb82 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:13.790133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4b516eb4-114f-45f2-a2f4-397a8a5ddb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:13.804070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:13.910646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 279/550] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:13.930460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d8c81-fe67-4a26-960a-26055d13f629 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:13.939816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b516eb4-114f-45f2-a2f4-397a8a5ddb82 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.006001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.006700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.006984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.007263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.008108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:14.008420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:14.009896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:14.035880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:14.046436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 272/551] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 18 14:42:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:14.050225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.083712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b516eb4-114f-45f2-a2f4-397a8a5ddb82 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:14.124357 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba213-3268-461f-8c5a-00f5772263a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.125204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba213-3268-461f-8c5a-00f5772263a5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.125492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba213-3268-461f-8c5a-00f5772263a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.125775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba213-3268-461f-8c5a-00f5772263a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.134809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:14.138949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ba213-3268-461f-8c5a-00f5772263a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-af0ba213-3268-461f-8c5a-00f5772263a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:14.149253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:14.150255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:14.151159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 280/552] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:14.152302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eed95-320c-4904-8de4-fae682428503 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.152407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eed95-320c-4904-8de4-fae682428503 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.156741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eed95-320c-4904-8de4-fae682428503 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.156741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 281/553] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:14.158739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eed95-320c-4904-8de4-fae682428503 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.171074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801c4c4-51b9-4a57-ac62-ee70a087801c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:14.220276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.221207 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.221693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.222194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.285789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eed95-320c-4904-8de4-fae682428503 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:14.291432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:14.294395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:14.296095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:14.326373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5bd92-ed1d-45bb-b1b0-b28791d9cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.327258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5bd92-ed1d-45bb-b1b0-b28791d9cc24 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.327733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5bd92-ed1d-45bb-b1b0-b28791d9cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.328217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5bd92-ed1d-45bb-b1b0-b28791d9cc24 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.329298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5bd92-ed1d-45bb-b1b0-b28791d9cc24 None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:14.329891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5bd92-ed1d-45bb-b1b0-b28791d9cc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:14.331479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5bd92-ed1d-45bb-b1b0-b28791d9cc24 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:14.341452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 282/554] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:14.343067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f842-16e4-4e9a-b79b-88fe90810f57 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.343560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f842-16e4-4e9a-b79b-88fe90810f57 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.344137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f842-16e4-4e9a-b79b-88fe90810f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.361712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-48d4f842-16e4-4e9a-b79b-88fe90810f57 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:14.363373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-48d4f842-16e4-4e9a-b79b-88fe90810f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:14.414586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 273/555] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:14.414586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.438365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:14.452468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 283/556] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:14.457740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f842-16e4-4e9a-b79b-88fe90810f57 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.528326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:14.534813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a551e33-0bf6-4324-9022-a231382322d1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:14.581561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.583096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.583598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.584090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.599307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:14.599620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f842-16e4-4e9a-b79b-88fe90810f57 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:14.601671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:14.627667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:14.628705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:14.629628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:14.629628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:14.629628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:14.629628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:14.632661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 274/557] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:14.633702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.645393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.646199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.646480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.646754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.660445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:14.661948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:14.685614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:14.687027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:14.687912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:14.687912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:14.687912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:14.687912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:14.691852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 284/558] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:14.692795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.750874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:14.771577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599e205-4ea4-4b95-9914-e13e794c438e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:14.812234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ca1c-e7b7-407c-b43d-2a1857e1e9c3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:14.820165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.821467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.821755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.822035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.836494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:14.848298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:14.849293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:14.850353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:14.852235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:14.852955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:14.853241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:14.853523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:14.853857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 275/559] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:14.858750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:14.858750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:14.858750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:14.860952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.876343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 285/560] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:14.877738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:14.891443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:14.986856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3fece-a171-4125-a0bd-5241ccc57246 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.020895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ccd3e-496b-481a-aecc-bfdfb9a8136b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.025092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.031534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.032679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.034571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.035121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.037014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:15.038131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.040741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.060858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 276/561] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:15.062229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.068043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c90b8e-5afc-458b-8db0-3eeaa36759e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.068794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90b8e-5afc-458b-8db0-3eeaa36759e0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.069083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90b8e-5afc-458b-8db0-3eeaa36759e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.069362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90b8e-5afc-458b-8db0-3eeaa36759e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.070114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c90b8e-5afc-458b-8db0-3eeaa36759e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:15.070483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c90b8e-5afc-458b-8db0-3eeaa36759e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.071860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c90b8e-5afc-458b-8db0-3eeaa36759e0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.080375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 286/562] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:15.085966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc46f0d-0457-477b-a278-eeb2eeb63c50 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.086265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc46f0d-0457-477b-a278-eeb2eeb63c50 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.086601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc46f0d-0457-477b-a278-eeb2eeb63c50 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.088753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 287/563] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:15.088753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc46f0d-0457-477b-a278-eeb2eeb63c50 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.136799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.167095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ae2a-7be1-4c35-88fd-b99367405b02 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.203779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.204608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.204891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.205164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.207127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc46f0d-0457-477b-a278-eeb2eeb63c50 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.216989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.218504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:15.233928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:15.235016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 277/564] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:15.235990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.252813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff63e-dccf-4ce7-ac60-29177e70de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.253618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff63e-dccf-4ce7-ac60-29177e70de26 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.253903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff63e-dccf-4ce7-ac60-29177e70de26 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.254179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff63e-dccf-4ce7-ac60-29177e70de26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.261113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff63e-dccf-4ce7-ac60-29177e70de26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.262543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff63e-dccf-4ce7-ac60-29177e70de26 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-d88ff63e-dccf-4ce7-ac60-29177e70de26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:15.276761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:15.277840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:15.278759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 288/565] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:15.279263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a224b-3610-4c53-87e0-7b52df034949 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.279471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a224b-3610-4c53-87e0-7b52df034949 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.279731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a224b-3610-4c53-87e0-7b52df034949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.296537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-019a224b-3610-4c53-87e0-7b52df034949 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:15.297752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-019a224b-3610-4c53-87e0-7b52df034949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:15.319060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.338000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca1e3-ad01-4bc6-b60f-899b9f7ac749 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.366369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 289/566] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:15.367387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.367749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6706-6e5b-4895-a43b-db4f6bfc3d15 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.368045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6706-6e5b-4895-a43b-db4f6bfc3d15 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.368326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6706-6e5b-4895-a43b-db4f6bfc3d15 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.373073 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.373934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 290/567] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:15.374330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.374617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.374727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6706-6e5b-4895-a43b-db4f6bfc3d15 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.374893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.385481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.387414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:15.405334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:15.406408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:15.407333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:15.407333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:15.407333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:15.407333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:15.407333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 278/568] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:15.407333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.483306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6706-6e5b-4895-a43b-db4f6bfc3d15 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.509801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00037d4d-18b8-470a-be6f-89b45e4b9f1e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.517123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c256d-6a43-4d22-b62a-32251dca30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.517800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c256d-6a43-4d22-b62a-32251dca30e4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.518088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c256d-6a43-4d22-b62a-32251dca30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.518369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c256d-6a43-4d22-b62a-32251dca30e4 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.519497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c256d-6a43-4d22-b62a-32251dca30e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:15.520049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c256d-6a43-4d22-b62a-32251dca30e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.523303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c256d-6a43-4d22-b62a-32251dca30e4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.541983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 291/569] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:15.543481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf51c4b-5410-463e-9b05-9a5629e8c052 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.543779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf51c4b-5410-463e-9b05-9a5629e8c052 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.544062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf51c4b-5410-463e-9b05-9a5629e8c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.544674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.545397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.545695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.545972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.546782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:15.547063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.548503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.560151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 279/570] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:15.560686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8bf51c4b-5410-463e-9b05-9a5629e8c052 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:15.561001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.561894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8bf51c4b-5410-463e-9b05-9a5629e8c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:15.571785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.606458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.629148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 292/571] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:15.630217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf51c4b-5410-463e-9b05-9a5629e8c052 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.661284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4851-6fd4-4027-b58c-96f2e6ff45ff None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.694691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e526e-2740-4048-90be-832553206165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.695484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e526e-2740-4048-90be-832553206165 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.695776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e526e-2740-4048-90be-832553206165 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.696052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e526e-2740-4048-90be-832553206165 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.705979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e526e-2740-4048-90be-832553206165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-643e526e-2740-4048-90be-832553206165 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:15.714440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:15.715522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:15.716364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 280/572] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:15.717358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e526e-2740-4048-90be-832553206165 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.745847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf51c4b-5410-463e-9b05-9a5629e8c052 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.779688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.780354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.780680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.780969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.781694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:15.782014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.783387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.795554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 293/573] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:15.796438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.800004 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.817832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e526e-2740-4048-90be-832553206165 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.820882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:15.857826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.858545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.858834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.859117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.869630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.871129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:15.888647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:15.889719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:15.890827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:15.890827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:15.890827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:15.890827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:15.890827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 281/574] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:15.891153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:15.906306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d6e8-7e8f-4656-98a5-85dcc1d11200 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:15.938814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:15.939464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:15.939753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:15.940028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:15.940935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=f2c1ef0b6b3241a19397b8696c05fc99) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:15.941252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:15.942701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:15.948564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 294/575] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/role_assignments?user.id=f2c1ef0b6b3241a19397b8696c05fc99&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:15.949362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.009760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693de55-9049-4e7c-945a-eb40bb7a695c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.024176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.049517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.050343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.050624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.050905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.062394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:16.063956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd663e3-38da-4f7e-8532-324bc3a661d5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:16.070962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:16.071994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:16.072877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 282/576] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:16.073608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.095601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.102274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.102939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.103153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.103433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.104195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:16.104520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.105927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.119437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 295/577] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:16.119437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.201170 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd194-9fe4-4514-81f3-35cefdec57bc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.237289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e5df-5b30-4e72-a5cc-7b2c06e42c48 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.237559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.238437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.238789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.239136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.248575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.250722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.267340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:16.270341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:16.271264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 283/578] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:16.277189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.277861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.278432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.278718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.279054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.279790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:16.280199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.282085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.297008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 296/579] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:16.298140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.358649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.383439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51e137-2a8b-4a6b-8ac5-516ac904c672 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.411459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab2434-ee88-4790-8d5d-0e32407c0129 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.418159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.419088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.419380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.419654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.420400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:16.420738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.422127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.430996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 284/580] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:16.432164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.455206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.456012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.456290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.456867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.467280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.468752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:16.486834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:16.487754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:16.488816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:16.488816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:16.488816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:16.488816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:16.493325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 297/581] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:16.494177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.539593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.544168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593fadb-dda6-4257-b165-7800fc1dedb0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.579801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.580478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.580789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.581070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.581908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:16.582221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.583665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.592642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.603212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 285/582] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:16.608423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2ec6-139a-4f20-b031-b2c068ce2042 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.608688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.645571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.646436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.646716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.646991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.654433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.655862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:16.671490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:16.672572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 298/583] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:16.673544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.716076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f8f7-3d5f-4d95-bbda-35acd85a88c1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.750560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.751360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.751648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.751929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.764022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.765796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:16.783115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:16.784041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:16.784969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:16.784969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:16.784969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:16.784969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:16.785191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487048c-984e-442b-9d86-52ec6a32aa52 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.786537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.789550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 286/584] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:16.790069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.825349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.826017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.826307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.826590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.827304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:16.827618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.829164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.837539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:16.846768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 299/585] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:16.846768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.895764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb79cc-61e1-49a4-82ed-10ba1d5982cd None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.940792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.941605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.941895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.942179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.953260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.954105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904d526-1da3-4f8e-a4e2-5b8698a78158 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:16.954720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:16.974298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:16.975269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:16.976195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:16.976195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:16.976195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:16.976195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:16.976195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 287/586] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:16.977387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:16.994430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:16.995089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:16.995370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:16.995645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:16.996422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:16.996773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:16.998188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.015123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 300/587] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:17.015123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.035864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.087943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.091383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969976ff-ebaf-443b-810f-9448a81f60fb None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.118784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b8f8a-0c2d-4531-b55d-0434b52cca84 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.136940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.137923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.138421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.138632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.139432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:17.139817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.141642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.154322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 288/588] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:17.155681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.156612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.157002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.157383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.159491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.165461 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.167023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:17.182247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:17.183390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:17.184482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 301/589] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:17.185129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.276163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34940-0125-4805-ac13-0c5edcd48ec1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.288998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.307487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af0fc2-1966-488a-9fa8-35a9e625e867 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.314182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.314947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.315235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.315513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.316229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:17.316707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.318178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.335934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 289/590] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:17.335934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.347329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.348224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.348509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.348824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/420ae644ec5548fbbde64ffa63c868ca/roles/b26281de225b480090083648f097a6d2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.358254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.364638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=420ae644ec5548fbbde64ffa63c868ca, role_id=b26281de225b480090083648f097a6d2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.366199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.379962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 302/591] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:17 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/420ae644ec5548fbbde64ffa63c868ca/roles/b26281de225b480090083648f097a6d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:17.381060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.487687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0c026-92ba-4a69-968f-3c9c0a6aed6d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.499499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db364205-881d-48d3-bbe7-dae603602522 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.538950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.542812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.543976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.544454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.544903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.546345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.547336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.547984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.548486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.549668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:17.550195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.551932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.556042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.557964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:17.577370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:17.578377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 14:42:17.579316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:17.579860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 303/592] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:17.579943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 290/593] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:17.580013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.585156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.670110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.689159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f157-f6a4-4b1a-a074-0edebf9d28a1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.708311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5aa33-030c-4a73-b592-bc547a0b1caf None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.727011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.728135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.728691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.729172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.740128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.742694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.749573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.750379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.750666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.750945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.760148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.761633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:17.766044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:17.766925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:17.767811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:17.767811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:17.767811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:17.767811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:17.770072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 291/594] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:17.771186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:17.777651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:17.778553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:17.779456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:17.783857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 304/595] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:17.784823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.862946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.896173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab4f84-68d2-4ef6-9487-5f2776787fab None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.929669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:17.934658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4713b6-e228-4c1d-93a7-a8056d4acb27 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:17.936801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.937724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.938211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.938709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.939743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:17.940255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.942012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:17.968884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 292/596] 10.222.0.59 () {56 vars in 1139 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:17.970315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:17.978304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:17.978981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:17.979269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:17.979548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:17.980272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:17.980609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:17.981985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.000720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 305/597] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:18.000720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.106863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2deca7c-6fdb-4833-b87c-0491b15f8bf9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.138849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91cd9-cf4a-4175-8c5e-965c2c3e7d0c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.151753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.152301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:18.153951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.154475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.154954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.155937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:18.156447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.158133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.173979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 293/598] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:18.175355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.182638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.183462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.183753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.184029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.195967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.196853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:18.215860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:18.216809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:18.217720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:18.217720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:18.217720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:18.217720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:18.217720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 306/599] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:18.218470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.247882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:18.302200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75935780-c99b-49d0-84ea-1c1a79d8bf81 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.332279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38f375-60d1-4395-8c2e-c57a5e6b8345 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.338208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e5699-23c9-45e8-bd9f-e2f3a752379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.339012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e5699-23c9-45e8-bd9f-e2f3a752379e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.339295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e5699-23c9-45e8-bd9f-e2f3a752379e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.339572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e5699-23c9-45e8-bd9f-e2f3a752379e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.346303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e5699-23c9-45e8-bd9f-e2f3a752379e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.347741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e5699-23c9-45e8-bd9f-e2f3a752379e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-7a9e5699-23c9-45e8-bd9f-e2f3a752379e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:18.363105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:18.364009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 294/600] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:18.365644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80da67-bf8e-44c9-81e5-7cbbff794701 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.366725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80da67-bf8e-44c9-81e5-7cbbff794701 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.366725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80da67-bf8e-44c9-81e5-7cbbff794701 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.368046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 295/601] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:18.372609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80da67-bf8e-44c9-81e5-7cbbff794701 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.375487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.376381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.376691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.376972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/06274e1b42f6471cac81889ec673a222/roles/b26281de225b480090083648f097a6d2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.391998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=06274e1b42f6471cac81889ec673a222, role_id=b26281de225b480090083648f097a6d2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.393469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.406703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 307/602] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:18 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/06274e1b42f6471cac81889ec673a222/roles/b26281de225b480090083648f097a6d2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:18.407258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.423365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:18.520953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433dc39-a48f-4073-8fe9-d8e22f64b44b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.537176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80da67-bf8e-44c9-81e5-7cbbff794701 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.553908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:18.563298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166f221-50f6-4daf-8e71-affa96f03fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.564359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166f221-50f6-4daf-8e71-affa96f03fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.564677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166f221-50f6-4daf-8e71-affa96f03fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.564964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166f221-50f6-4daf-8e71-affa96f03fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.565782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166f221-50f6-4daf-8e71-affa96f03fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:18.566157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166f221-50f6-4daf-8e71-affa96f03fd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.568399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166f221-50f6-4daf-8e71-affa96f03fd0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.587119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.587993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.588358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.588778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.589705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:18.590087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.590628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 308/603] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:18.591703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.592064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e3ea-b608-4fff-8485-54cbbf19149e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.592358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e3ea-b608-4fff-8485-54cbbf19149e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.592669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e3ea-b608-4fff-8485-54cbbf19149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.611279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 296/604] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:18.612259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.619841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7917e3ea-b608-4fff-8485-54cbbf19149e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:18.620082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7917e3ea-b608-4fff-8485-54cbbf19149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:18.701046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 309/605] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:18.701910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917e3ea-b608-4fff-8485-54cbbf19149e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.704233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:18.726161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9d13-3c80-4cb3-9b95-ee75a756b1dc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.760784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.761778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.762068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.762344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/6b2524791e2943c2a1eeae24e17c4f34/roles/b26281de225b480090083648f097a6d2` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.778789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=6b2524791e2943c2a1eeae24e17c4f34, role_id=b26281de225b480090083648f097a6d2)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.780379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.799034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 297/606] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:18 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/6b2524791e2943c2a1eeae24e17c4f34/roles/b26281de225b480090083648f097a6d2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:18.804737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.824480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917e3ea-b608-4fff-8485-54cbbf19149e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:18.861595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:18.880716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:18.882506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:18.882792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:18.883063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:18.902370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:18.903988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:18.931201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:18.934416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:18.935651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 310/607] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:18.940095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:18.991608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f841-aba6-497a-ae7b-522fe36065d5 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:19.040435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:19.042032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.042032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.042032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.060271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:19.061249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:19.069783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:19.070753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:19.071698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 298/608] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:19.076715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:19.115872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f84a70-cdea-4aac-8897-74d5d1b98d28 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:19.165559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:19.167619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.168146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.168892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.169637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:19.172150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:19.173595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:19.174325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:19.189990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 311/609] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:19.196312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:19.247572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e843-185b-43e4-ba9d-8497c4485238 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:19.312231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dc5b4-61ca-4c07-9dd5-deb85eda34d0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:19.339220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:19.352612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:19.354240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.354691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.355264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/1aa975bb70624500aa802e7a708014c2/roles/b26281de225b480090083648f097a6d2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.372268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=1aa975bb70624500aa802e7a708014c2, role_id=b26281de225b480090083648f097a6d2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:19.374084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:19.378869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:19.379677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.380020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.380557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.382093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:19.382373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:19.383956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:19.391511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 312/610] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:19 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/1aa975bb70624500aa802e7a708014c2/roles/b26281de225b480090083648f097a6d2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:42:19.415080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 299/611] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:19.420700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:19.547337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf78e61-8f4e-4e89-9a74-2739f3eff971 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:19.585754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:19.586909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.587405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.587882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.600407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:19.602273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:19.621976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:19.622956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:19.623865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:19.623865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:19.623865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:19.623865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:19.626484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 313/612] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:19.632373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:19.768055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d652d-cdce-414d-b4f6-ae473f513d96 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:19.805532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94ad2-9b61-4961-96d8-c2166c379ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:19.806652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94ad2-9b61-4961-96d8-c2166c379ea7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.807161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94ad2-9b61-4961-96d8-c2166c379ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.807687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94ad2-9b61-4961-96d8-c2166c379ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.808646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94ad2-9b61-4961-96d8-c2166c379ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:19.809156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94ad2-9b61-4961-96d8-c2166c379ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:19.810763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94ad2-9b61-4961-96d8-c2166c379ea7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:19.824109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 300/613] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:19.829271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:19.869849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:19.926392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca707b-3b91-4d5d-962f-bae36edfe3ba None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.926737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca707b-3b91-4d5d-962f-bae36edfe3ba None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.926991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca707b-3b91-4d5d-962f-bae36edfe3ba None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.929544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 301/614] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:19.935499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472bba-f2f8-4eb1-bcec-60319338920a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:19.935939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472bba-f2f8-4eb1-bcec-60319338920a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:19.936223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472bba-f2f8-4eb1-bcec-60319338920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:19.946780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:19.972503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-27472bba-f2f8-4eb1-bcec-60319338920a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:19.976385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-27472bba-f2f8-4eb1-bcec-60319338920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:19.982173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331adc-f060-4b05-ab38-a33246cfe1f5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:20.059151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:20.060326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:20.060955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:20.061466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:20.066821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 302/615] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:42:20.072663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:20.074229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:20.089548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:20.090513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:20.091474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 314/616] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:20.097936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472bba-f2f8-4eb1-bcec-60319338920a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.102985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.201023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:20.234536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ea0d8-9046-4150-98a5-9528639ca354 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:20.284068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472bba-f2f8-4eb1-bcec-60319338920a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:20.304681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:20.305916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:20.306443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:20.306929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:20.330141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:20.339184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:20.340119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:20.341000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:20.349610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 315/617] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:20.349896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:20.354731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.369313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:20.370008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:20.370298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:20.370581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:20.371437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:20.371755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:20.373266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:20.416300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 303/618] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:20.421523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.471616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f558a9d-93b1-4ff9-9830-de943bcba673 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:20.510520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:20.511220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:20.511503 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:20.511780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:20.512530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:20.512862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:20.514233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:20.523983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 316/619] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:20.529316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.541041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:20.590857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97cb4a-71dc-4a90-9585-492bb6f33363 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:20.627965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:20.628930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:20.629220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:20.629498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:20.640287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:20.641964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:20.644344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08c90-7a09-454c-8ddc-0921dc313fd3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:20.672620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:20.673620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:20.674990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:20.674990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:20.674990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:20.674990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:20.674990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 304/620] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:20.680941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.690075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:20.690917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:20.691209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:20.691496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:20.715091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:20.716736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:20.726935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:20.746600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:20.748693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:20.750875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:20.750875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:20.750875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:20.750875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:20.757041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 317/621] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:20.763595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.796905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e55e3-f68f-4835-accd-d34a9a418d08 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:20.835290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:20.835991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:20.836279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:20.836565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:20.837330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:20.837640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:20.839322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:20.851989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 305/622] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:20.857365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:20.889924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:20.962350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7b973-06c2-4879-92ee-8524d5ce06df None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.013400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b74b11-815c-41bd-a97d-96ff32107cba None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.015122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:21.016914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958775a7-9692-4d0b-a32a-1ab1e93b952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.020884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958775a7-9692-4d0b-a32a-1ab1e93b952d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.020884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958775a7-9692-4d0b-a32a-1ab1e93b952d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.020884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958775a7-9692-4d0b-a32a-1ab1e93b952d None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.020884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958775a7-9692-4d0b-a32a-1ab1e93b952d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:21.020884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958775a7-9692-4d0b-a32a-1ab1e93b952d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.020884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958775a7-9692-4d0b-a32a-1ab1e93b952d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.034311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 318/623] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:21.035727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710767-a7da-4c2e-878a-ebbd6d5e944c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.036088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710767-a7da-4c2e-878a-ebbd6d5e944c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.036441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710767-a7da-4c2e-878a-ebbd6d5e944c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.038301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 319/624] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:21.043094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710767-a7da-4c2e-878a-ebbd6d5e944c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.053762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ed4fa-c567-4572-8679-28f86bbb7562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.054644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ed4fa-c567-4572-8679-28f86bbb7562 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.055096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ed4fa-c567-4572-8679-28f86bbb7562 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.055445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ed4fa-c567-4572-8679-28f86bbb7562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.063195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ed4fa-c567-4572-8679-28f86bbb7562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.064883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ed4fa-c567-4572-8679-28f86bbb7562 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-446ed4fa-c567-4572-8679-28f86bbb7562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:21.081105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:21.082546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:21.084676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 306/625] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:21.085846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813bbd-3a96-4a96-b1e5-8bced29e6217 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.085846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813bbd-3a96-4a96-b1e5-8bced29e6217 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.086127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813bbd-3a96-4a96-b1e5-8bced29e6217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.104777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-fd813bbd-3a96-4a96-b1e5-8bced29e6217 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:21.106081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-fd813bbd-3a96-4a96-b1e5-8bced29e6217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:21.153909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710767-a7da-4c2e-878a-ebbd6d5e944c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.177919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:21.187856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 307/626] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:21.189030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813bbd-3a96-4a96-b1e5-8bced29e6217 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.218415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.219213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.219502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.219782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.228471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.230204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:21.246700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:21.247710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:21.248694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 320/627] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:21.249306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.318999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:21.331324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813bbd-3a96-4a96-b1e5-8bced29e6217 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.363075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e9d60-e59a-4c99-b307-88508ba18391 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.377735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.378842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.379275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.380171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.381544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:21.382006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.384278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.400566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 308/628] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:21.401819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.402288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.408865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.408865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.408865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.419555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:21.427424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:21.429226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:21.430097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 321/629] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:21.430811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.477572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:21.537283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d56281-8eb2-475f-850b-f25f8cb12d45 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.555234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb5b34-28cd-4956-a6ae-1860d268cdd2 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.582117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.583385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.584884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.585634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.586930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:21.587849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.589909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.592835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.593913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.594099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.594381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/f2c1ef0b6b3241a19397b8696c05fc99/roles/b26281de225b480090083648f097a6d2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.611300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=f2c1ef0b6b3241a19397b8696c05fc99, role_id=b26281de225b480090083648f097a6d2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.612862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.614001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 309/630] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 18 14:42:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:21.615036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.632103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 322/631] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:21 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/f2c1ef0b6b3241a19397b8696c05fc99/roles/b26281de225b480090083648f097a6d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:21.636843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.639621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:21.757397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0231ca8-18ff-40f3-8c3e-c0b6cc835cf1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.758134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:21.775219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698af0-a7d6-4a5f-aed7-d5d0791a4a0b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.810798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af52b4-d492-48c5-9ddb-359ed60c57e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.811746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af52b4-d492-48c5-9ddb-359ed60c57e6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.812468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af52b4-d492-48c5-9ddb-359ed60c57e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.812852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af52b4-d492-48c5-9ddb-359ed60c57e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.813957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af52b4-d492-48c5-9ddb-359ed60c57e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:21.814277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af52b4-d492-48c5-9ddb-359ed60c57e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.816743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af52b4-d492-48c5-9ddb-359ed60c57e6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.821105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.821772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.822057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.822339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.827350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 310/632] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:21.828061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6fad7-899f-42d0-8d5a-a0059f95f4b4 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.828351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6fad7-899f-42d0-8d5a-a0059f95f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.828653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6fad7-899f-42d0-8d5a-a0059f95f4b4 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.830243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 311/633] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:21.831549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6fad7-899f-42d0-8d5a-a0059f95f4b4 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:21.910875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.912258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:21.944514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:21.948755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6fad7-899f-42d0-8d5a-a0059f95f4b4 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:21.985248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555c582-00cb-4bbf-a2b6-a876407a7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:21.986053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c582-00cb-4bbf-a2b6-a876407a7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:21.986338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c582-00cb-4bbf-a2b6-a876407a7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:21.986615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c582-00cb-4bbf-a2b6-a876407a7ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:21.997933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555c582-00cb-4bbf-a2b6-a876407a7ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:21.999413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555c582-00cb-4bbf-a2b6-a876407a7ac8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.016473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-9555c582-00cb-4bbf-a2b6-a876407a7ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:22.019640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:22.020530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:22.021464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:22.021464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:22.021464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:22.021464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:22.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 312/634] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:22.027804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aecc36-f271-45e0-941d-f616eab1687c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.028095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aecc36-f271-45e0-941d-f616eab1687c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.028380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aecc36-f271-45e0-941d-f616eab1687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.038203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 323/635] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:22.039417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.052122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d4aecc36-f271-45e0-941d-f616eab1687c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:22.054023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d4aecc36-f271-45e0-941d-f616eab1687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:22.131524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 313/636] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:22.132482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aecc36-f271-45e0-941d-f616eab1687c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.166217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ca0c-ffa2-44b9-a90e-314dd508a740 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.193118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.222975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.224518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.226085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.226577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.227739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:22.228489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.230439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.245560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aecc36-f271-45e0-941d-f616eab1687c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.246597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 324/637] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:22.247854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.283502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.284309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.284607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.284957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.297705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.299188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.303100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:22.317428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:22.318543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:22.320139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:22.320139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:22.320139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:22.320139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:22.323006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 314/638] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:22.323827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.362475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01425a8-6a5f-44c4-a880-88931c398f7e None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.401143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9230c84-5d46-4194-a486-921769e7a602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.402336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9230c84-5d46-4194-a486-921769e7a602 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.402815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9230c84-5d46-4194-a486-921769e7a602 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.403267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9230c84-5d46-4194-a486-921769e7a602 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.414332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9230c84-5d46-4194-a486-921769e7a602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-f9230c84-5d46-4194-a486-921769e7a602 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:22.422657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:22.423563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:22.424401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:22.426655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 325/639] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:22.428042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315efeb6-fd6a-4ce9-9965-8c5e4182f258 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.428249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c295d-ba2e-46a2-9cc7-f9451230120a None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.428692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c295d-ba2e-46a2-9cc7-f9451230120a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.429112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c295d-ba2e-46a2-9cc7-f9451230120a None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.430498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 326/640] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:22.431378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c295d-ba2e-46a2-9cc7-f9451230120a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.441787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.471629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.472433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.472752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.473035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.482087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.483632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:22.498705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:22.499720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 315/641] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:22.505629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.541643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c295d-ba2e-46a2-9cc7-f9451230120a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.551851 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.577432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a3cc4-9360-4615-afe5-db4d26dbc614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.578093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3cc4-9360-4615-afe5-db4d26dbc614 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.578378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3cc4-9360-4615-afe5-db4d26dbc614 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.578652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3cc4-9360-4615-afe5-db4d26dbc614 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.579363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3cc4-9360-4615-afe5-db4d26dbc614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:22.579670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3cc4-9360-4615-afe5-db4d26dbc614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.581066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3cc4-9360-4615-afe5-db4d26dbc614 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.597948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 327/642] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:22.597948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9b937-5cfb-42fd-876a-45b4a35fca16 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.597948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9b937-5cfb-42fd-876a-45b4a35fca16 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.597948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9b937-5cfb-42fd-876a-45b4a35fca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.611791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d0d9b937-5cfb-42fd-876a-45b4a35fca16 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:22.613000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d0d9b937-5cfb-42fd-876a-45b4a35fca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:22.615306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90992e-4ac5-4096-aa05-7b65eb6ea068 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.651119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.651785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.652069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.652347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.653121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:22.653441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.654815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.663125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 316/643] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:22.663721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.688664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 328/644] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:22.689764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9b937-5cfb-42fd-876a-45b4a35fca16 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.699245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.773354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1e00-90ee-42af-8c69-896eaad8d9e9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.794514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.800184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9b937-5cfb-42fd-876a-45b4a35fca16 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.807929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.808653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.808922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.809204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.810107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:22.810360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.811832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.830090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 317/645] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:22.830987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.842608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.843829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.844290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.844917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.852536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.854013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:22.868488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:22.869557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:22.870642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 329/646] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:22.871138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:22.926463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:22.944622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731187d-5a0d-4414-8fea-c3eec0e5c847 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.981015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:22.981821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:22.982104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:22.982386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:22.987092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2a84c-9159-4387-9f29-341ef8a50df5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:22.998709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:22.999815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:23.018298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:23.019240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:23.020181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:23.020181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:23.020181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:23.020181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:23.020181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 318/647] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:23.020464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.034119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.034914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.035199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.035473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.046657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:23.055025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:23.056145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:23.057296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:23.060759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 330/648] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:23.061565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.082165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.133192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83653fa-7d57-4532-8637-c50e41a7a67f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.166960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.167689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.167977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.168253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.169238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769093-514c-4398-9394-b2a7b6299e29 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.177364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.204375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.205001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.205286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.205561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.206331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:23.206638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.210846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.223639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 331/649] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:23.225089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.252199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.253873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.310798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.342039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae092234-45bf-427d-ac63-6f9df170a405 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.363710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 319/650] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:23.363710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.384832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.385502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.385787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.386133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.386859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:23.387169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.388533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.401405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 332/651] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:23.403604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.408241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.473428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c05a0-440c-4a60-baaa-2348492500a9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.505709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8848cb-f0b0-49b0-af48-ba286346f6f5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.507968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.508670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.508957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.509238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.509984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:23.510295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.511676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.524370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 320/652] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:23.524370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.546936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.547628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.547890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.548170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.549041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=420ae644ec5548fbbde64ffa63c868ca) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:23.549365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.550803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.568619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 333/653] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/role_assignments?user.id=420ae644ec5548fbbde64ffa63c868ca&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:23.568619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.568619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.647948 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.651195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b59e-21bd-44a7-ac0f-ed554f508dd5 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.696438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.697336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.697806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.698217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.712144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3857e7a-54ff-4ff0-960d-dfdf03260f28 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.716605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.718188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:23.742158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:23.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:23.744309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:23.744309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:23.744309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:23.744309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:23.744309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 321/654] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:23.745594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.757379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.758200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.758490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.758766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.770418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.772468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:23.792506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:23.793814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:42:23.794771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:23.797152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 334/655] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:23.798224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.877054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.893811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3109-0e8c-4e34-aa9a-bdaf306b826e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.930026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b160607-71ff-481b-a07e-7952937db48c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:23.942973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.944364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.944929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.945070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.956667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.958137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.975393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59a47-1c00-4da9-b03b-cd97dac8c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:23.976198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59a47-1c00-4da9-b03b-cd97dac8c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:23.976387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:23.977325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:23.978223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:23.978223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:23.978223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:23.978223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:23.978459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59a47-1c00-4da9-b03b-cd97dac8c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.978459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59a47-1c00-4da9-b03b-cd97dac8c6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:23.978459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59a47-1c00-4da9-b03b-cd97dac8c6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:23.978459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59a47-1c00-4da9-b03b-cd97dac8c6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:23.978707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 322/656] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:23.978707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:23.979379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e59a47-1c00-4da9-b03b-cd97dac8c6c7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:23.987443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:23.992764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 335/657] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:23.995165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0e22-f064-44d1-805c-2ea6174c1403 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:23.995693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0e22-f064-44d1-805c-2ea6174c1403 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:23.996544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0e22-f064-44d1-805c-2ea6174c1403 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.000434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 336/658] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:24.001266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0e22-f064-44d1-805c-2ea6174c1403 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.091859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d446c-9bc6-4dad-adc0-306460ce2a95 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.111063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0e22-f064-44d1-805c-2ea6174c1403 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.127301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.127969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.128251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.128524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.129501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:24.129938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:24.131405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:24.136198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:24.148446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a6ef9-63fb-4104-936d-f9a8c83b565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.149144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a6ef9-63fb-4104-936d-f9a8c83b565d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.149437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a6ef9-63fb-4104-936d-f9a8c83b565d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.149718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a6ef9-63fb-4104-936d-f9a8c83b565d None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.150446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a6ef9-63fb-4104-936d-f9a8c83b565d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:24.150758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a6ef9-63fb-4104-936d-f9a8c83b565d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:24.156191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 323/659] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 18 14:42:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:24.156335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a6ef9-63fb-4104-936d-f9a8c83b565d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:24.156428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.170561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 337/660] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:24.172047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccac9-e1ce-4bab-b9f5-1559a9bd7266 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.172341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccac9-e1ce-4bab-b9f5-1559a9bd7266 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.172659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccac9-e1ce-4bab-b9f5-1559a9bd7266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.189895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-664ccac9-e1ce-4bab-b9f5-1559a9bd7266 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:24.191104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-664ccac9-e1ce-4bab-b9f5-1559a9bd7266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:24.233762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:24.266713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 338/661] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:24.267488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccac9-e1ce-4bab-b9f5-1559a9bd7266 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.282500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2fd0f-1399-41d0-acab-accd3dc1a562 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.324628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.325472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.325760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.326041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.333129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:24.334714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:24.353266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:24.354210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:24.355095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 324/662] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:24.355605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.383548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccac9-e1ce-4bab-b9f5-1559a9bd7266 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.397705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:24.421722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.422408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.422695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.422984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.465671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf163a8-75b3-4e47-bbbe-36ae1fea4e72 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.489661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:24.496939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:24.498390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:24.503484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.504297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.504601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.504896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.513620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:24.515197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:24.530305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:24.531507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 14:42:24.532697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:24.536163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 325/663] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:24.537029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.614058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 339/664] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:24.614058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.625661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:24.722506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61189ae-9f78-4a07-b4aa-f37bd274bec5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.762347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.763436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.763728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.764167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.765014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:24.765331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:24.766780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:24.783627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 340/665] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:24.784330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.795427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e562d-e9db-4d75-a236-89c4dc9bbb09 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.833975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.835813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.836101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.836379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.847747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:24.855581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:24.856558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:24.857483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 326/666] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:24.858201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.866598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:24.900977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b2bf-29fb-4ab1-9105-d40765d39e56 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:24.904840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:24.938906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:24.939691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:24.939973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:24.940249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:24.941107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:24.941414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:24.943130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:24.962012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 341/667] 10.222.0.59 () {56 vars in 1139 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:24.962839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:24.968676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a876fa-a0fd-4319-98d7-0086774068e1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.006531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.007698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.008175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.008690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.023798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.026024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:25.046503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:25.047466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:25.048375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:25.048375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:25.048375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:25.048375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:25.048375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 327/668] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:25.048375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.086230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492926a2-67cb-4f9d-b9b5-320abd07b213 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.115923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:25.122983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.123631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.123913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.124189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.125045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=06274e1b42f6471cac81889ec673a222) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:25.125355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.126772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.144609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 342/669] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:24 2022] GET /identity/v3/role_assignments?user.id=06274e1b42f6471cac81889ec673a222&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:25.144609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.157863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:25.167586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80290614-9593-40bb-9644-3f25ed2fa891 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.228334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.229425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.229907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.230417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.231413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:25.231928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.233591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.248313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 328/670] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:25.249645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.277897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49c72-e6f8-45fc-9c07-4accb5b4edda None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.315242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.315830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.316116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.316424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.364404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff1a38-166c-4040-82cd-eac21a907f4a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.390385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:25.400198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.402613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.414483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.415202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.415491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.415772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.416537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:25.416995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.418648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.432057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 329/671] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:25.432947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.457765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:25.516565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 343/672] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:25.517467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.569667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08e75c-3174-493a-9b9d-7d51b154f0ff None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.613606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.614651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.615105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.615563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.618693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:25.625718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbd93-6489-4330-bb74-c9bf1b089aaf None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.626995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.628634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:25.649423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:25.650446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:25.651366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:25.651366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:25.651366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:25.651366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:25.653672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 330/673] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:25.654792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.663945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.664789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.665077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.665358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.672819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.674302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:25.688598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:25.689513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:25.690875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:25.695140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 344/674] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:25.695965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.732962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:25.764831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc7287-068e-40b4-998b-def42ef93fef None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.807856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.808095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a0d9-d357-41e9-a2bc-258af515f314 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.809194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.809681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.810154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.821725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.823514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:25.844495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:25.845434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:25.846358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:25.846358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:25.846358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:25.846358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:25.848675 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 331/675] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:25.849780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.859097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:25.860057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:25.860544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:25.861070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:25.862000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:25.862526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:25.864507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:25.880055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 345/676] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:25.881935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:25.901070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:25.977107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3679aa-ada1-4665-a2f5-d7ef2ad7d03a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.993372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e5cd5-7aaa-449f-8334-572161d3be64 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:25.998484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:26.013598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.014256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.014538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.014814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.015597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:26.015901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.017388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.035721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 332/677] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:26.035721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.040507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d788eff-6763-4426-b9cb-0f7812283deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.041216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d788eff-6763-4426-b9cb-0f7812283deb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.041499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d788eff-6763-4426-b9cb-0f7812283deb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.041776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d788eff-6763-4426-b9cb-0f7812283deb None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.042503 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d788eff-6763-4426-b9cb-0f7812283deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:26.042811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d788eff-6763-4426-b9cb-0f7812283deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.044448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d788eff-6763-4426-b9cb-0f7812283deb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.061654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 346/678] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:26.063697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee43e9-8b62-41b5-84ce-f9ec414d5728 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.064133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee43e9-8b62-41b5-84ce-f9ec414d5728 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.064718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee43e9-8b62-41b5-84ce-f9ec414d5728 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.066611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 347/679] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:26.067748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee43e9-8b62-41b5-84ce-f9ec414d5728 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.150782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250afce-e562-429a-9df6-93f7fa57beee None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.152708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:26.180960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee43e9-8b62-41b5-84ce-f9ec414d5728 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.185891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.186694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.186978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.187253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.200380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.201904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:26.217483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:26.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:26.219401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:26.220598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4c9b6-400c-4400-a84f-2ba73f3acc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.220598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4c9b6-400c-4400-a84f-2ba73f3acc75 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.220598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4c9b6-400c-4400-a84f-2ba73f3acc75 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.220820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 333/680] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:26.220820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.223405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4c9b6-400c-4400-a84f-2ba73f3acc75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.224266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4c9b6-400c-4400-a84f-2ba73f3acc75 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=6b2524791e2943c2a1eeae24e17c4f34) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:26.224615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4c9b6-400c-4400-a84f-2ba73f3acc75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.226070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4c9b6-400c-4400-a84f-2ba73f3acc75 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.241129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 348/681] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/role_assignments?user.id=6b2524791e2943c2a1eeae24e17c4f34&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:26.241129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0fce9-5452-4104-bf2b-b8804dd829ba None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.241129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0fce9-5452-4104-bf2b-b8804dd829ba None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.241129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0fce9-5452-4104-bf2b-b8804dd829ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.266064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f2d0fce9-5452-4104-bf2b-b8804dd829ba None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:26.267584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f2d0fce9-5452-4104-bf2b-b8804dd829ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:26.282839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:26.358460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e959-3010-4847-996d-e87589d3d9e1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.364184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 349/682] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:26.366496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0fce9-5452-4104-bf2b-b8804dd829ba None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.411655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.413112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.413401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.413682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.422716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.423573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:26.441413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:26.442392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:26.443278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:26.447595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 334/683] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:26.448559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.468016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:26.511545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0fce9-5452-4104-bf2b-b8804dd829ba None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.561640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.562326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.562856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.563154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.564453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:26.564805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.566813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.571185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:26.577799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c014f5-9d70-4a3c-9368-56fdeb8abacd None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.591102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 350/684] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:26.592083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.617177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.618423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.618906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.619382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.630893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.632887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:26.652214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:26.653492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:26.654405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:26.654405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:26.654405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:26.654405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:26.656647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 335/685] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:26.657633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.712826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595031f-3775-433a-8b6a-933227f1f66f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.740737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:26.751249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.752210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.752730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.753227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.754207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:26.754760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.756467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.768829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 351/686] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:26.769914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.774544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb8a67-a01b-47a2-bbfb-62ea6950687a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.812473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.813156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.813442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.813723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.837699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:26.877170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa0f3e-eb3e-488d-bf64-e287e1a8cd43 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:26.888738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.890215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.914612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:26.915781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:26.916373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:26.916896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:26.917869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:26.918695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:26.920531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:26.933665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 352/687] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:26.934869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:26.993492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:27.006355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 336/688] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:27.007610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:27.066726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:27.072914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e01a3-a060-4470-b2f2-24abca8f65fe None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:27.111712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:27.112562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.112792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.113078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.113951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=1aa975bb70624500aa802e7a708014c2) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:27.114315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:27.116103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:27.119929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3729-e5d6-4e84-9c0a-93d52237992c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:27.128486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 353/689] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:26 2022] GET /identity/v3/role_assignments?user.id=1aa975bb70624500aa802e7a708014c2&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:27.129104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:27.161734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:27.163946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.164711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.166709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.167711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:27.170656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:27.224889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 337/690] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:42:27 2022] POST /identity/v3/users => generated 254 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:27.302587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7ce6-ada9-4ecc-97fc-e4e409233cc3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:27.315705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:27.348607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a9f16-5103-4584-8084-4cfe1458dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:27.349934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9f16-5103-4584-8084-4cfe1458dd8f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.350422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9f16-5103-4584-8084-4cfe1458dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.350911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9f16-5103-4584-8084-4cfe1458dd8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.365516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a9f16-5103-4584-8084-4cfe1458dd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:27.367928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a9f16-5103-4584-8084-4cfe1458dd8f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-284a9f16-5103-4584-8084-4cfe1458dd8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:27.389196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:27.390241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:27.391197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:27.391197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:27.391197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:27.391197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:27.394007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 354/691] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:27.400903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:27.536184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084fcfa-7798-4c09-9cce-bceae4f24342 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:27.547937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:27.582471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:27.583057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.583348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.583625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.584399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:27.584750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:27.586145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:27.586816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3484-2a4b-4db2-a49d-616965f8746f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.587107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3484-2a4b-4db2-a49d-616965f8746f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.587388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3484-2a4b-4db2-a49d-616965f8746f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.591066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 355/692] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:27.596744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f948-f9fe-408d-923a-86fadf8893b5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.596744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f948-f9fe-408d-923a-86fadf8893b5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.597057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f948-f9fe-408d-923a-86fadf8893b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.600613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 338/693] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:27.605442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:27.618779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-79d3f948-f9fe-408d-923a-86fadf8893b5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:27.620354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-79d3f948-f9fe-408d-923a-86fadf8893b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:27.706347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 356/694] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:42:27.736358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f948-f9fe-408d-923a-86fadf8893b5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:27.747940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b092030-ce55-410c-919a-9576ce025d8f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:27.797371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:27.798188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.798501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.798780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.811469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:27.812951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:27.842124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:27.842674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:27.843565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:27.844871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 339/695] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:27.849627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:27.855679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f948-f9fe-408d-923a-86fadf8893b5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:27.897985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:27.898800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:27.899083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:27.899361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:27.905113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:27.922617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:27.931277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:27.932219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:27.933127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:27.937015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 357/696] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:27.939156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:28.040593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1aa6e-52b3-4a0a-a47b-fb3322cb7260 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:28.080461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:28.081155 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.081440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.081719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.083095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:28.083416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:28.085773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:28.107622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 340/697] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:28.113044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:28.155399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606158a3-eaef-4e71-a2d0-5f22ec781f8c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:28.224548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:28.225292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.225579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.225855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.226612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:28.226921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:28.228317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:28.250218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 358/698] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:28.257805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:28.264232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:28.276736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:28.301500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386afe0-1cfd-4216-9dd6-b9e77784a696 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:28.362951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:28.363906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.367598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.368072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.369115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=f2c1ef0b6b3241a19397b8696c05fc99) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:28.371096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:28.377674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:28.389536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 341/699] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:28 2022] GET /identity/v3/role_assignments?user.id=f2c1ef0b6b3241a19397b8696c05fc99&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:28.406737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ba6b-8f24-4f06-91be-c2c7c1863312 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:28.445819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:28.446975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.447457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.447963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.460284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:28.462068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:28.480718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:28.481673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:28.482563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:28.482563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:28.482563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:28.482563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:28.484729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 359/700] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:28.492708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:28.633721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45370-5bff-4fdf-9c05-e1042c470540 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:28.672602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09f35-d7e1-46a5-b2c9-94e4a8fd411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:28.673293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09f35-d7e1-46a5-b2c9-94e4a8fd411b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.673576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09f35-d7e1-46a5-b2c9-94e4a8fd411b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.673851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09f35-d7e1-46a5-b2c9-94e4a8fd411b None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.674583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09f35-d7e1-46a5-b2c9-94e4a8fd411b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:28.674889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09f35-d7e1-46a5-b2c9-94e4a8fd411b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:28.676303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09f35-d7e1-46a5-b2c9-94e4a8fd411b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:28.689717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 342/701] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:28.694858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:28.761073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:28.799816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3955d7-711e-4641-ad49-97b5e3152969 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:28.802451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e580d37-e395-435f-9ce4-6f111f765516 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.803571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e580d37-e395-435f-9ce4-6f111f765516 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.804133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e580d37-e395-435f-9ce4-6f111f765516 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.805870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 343/702] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:28.812712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd39a3-6cc7-4771-9c21-896f71cc361e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.813000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd39a3-6cc7-4771-9c21-896f71cc361e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.813278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd39a3-6cc7-4771-9c21-896f71cc361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.832366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-6bcd39a3-6cc7-4771-9c21-896f71cc361e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:28.835055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6bcd39a3-6cc7-4771-9c21-896f71cc361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:28.840953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:28.842027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:28.842997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:28.843490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:28.846616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:28.855079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:28.857066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:28.875719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:28.877221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:28.878245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 360/703] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:42:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:28.884878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:28.921855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 344/704] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 14:42:28.945518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd39a3-6cc7-4771-9c21-896f71cc361e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:29.031071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afde74-6798-4b78-bb0b-3a6d7858d4aa None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:29.068554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:29.073289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd39a3-6cc7-4771-9c21-896f71cc361e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:29.078598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:29.079394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:29.079753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:29.080110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:29.081073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:29.081457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:29.082984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:29.105386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 361/705] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:42:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:29.111986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:29.122851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:29.123675 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:29.123968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:29.124251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:29.124952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:29.128611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:29.145231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:29.146403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:29.147495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 345/706] 10.222.0.59 () {56 vars in 1129 bytes} [Wed May 18 14:42:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:29.153368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:29.165936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:29.263108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71ebf9-c8cf-4206-9e23-42ebbcad21ed None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:29.302457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:29.303996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:29.304423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:29.305018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:29.372965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:29.382992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:29.386990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:29.388939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08777dc-f7db-465b-9de4-3575e31ea19a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:29.481307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:29.482100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:29.482454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:29.482807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:29.483600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:29.483980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:29.485465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:29.491948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 362/707] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:29.497901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:29.500100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 346/708] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 18 14:42:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:29.514961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:29.597074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:29.605655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2da495-5a28-4faf-b8df-27734aa4b1c7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:29.648043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:29.649683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:29.650277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:29.650741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:29.661540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:29.663983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:29.671289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:29.694756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:29.695704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:29.704738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:29.704738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:29.704738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:29.704738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:29.706855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 363/709] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:29.709999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6175ef3-92ba-4cb5-9b57-7cdc39e18991 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:29.713324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:29.757124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:29.757730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:29.758017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:29.758296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:29.759026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:29.759338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:29.760802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:29.776271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 347/710] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 18 14:42:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:29.866504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5fd9e-dd56-4171-b27d-662da8c677bb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:29.903501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5e3b6-c1a1-4b3e-9ccd-a4aa53f94ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:29.904188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e3b6-c1a1-4b3e-9ccd-a4aa53f94ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:29.904475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e3b6-c1a1-4b3e-9ccd-a4aa53f94ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:29.904787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e3b6-c1a1-4b3e-9ccd-a4aa53f94ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:29.905536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5e3b6-c1a1-4b3e-9ccd-a4aa53f94ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:29.905849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5e3b6-c1a1-4b3e-9ccd-a4aa53f94ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:29.907293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5e3b6-c1a1-4b3e-9ccd-a4aa53f94ae8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:29.910112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:29.922153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 364/711] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:29.927373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.047393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144dbb-d9a3-42c8-a765-e1cc84456db4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:30.054132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed6553-b499-4ae1-ac1e-53b361d7c80f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.054557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed6553-b499-4ae1-ac1e-53b361d7c80f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.054940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed6553-b499-4ae1-ac1e-53b361d7c80f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.060548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 365/712] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:30.061749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387eb4-7f73-46fe-8cc3-484e88ac6730 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.062039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387eb4-7f73-46fe-8cc3-484e88ac6730 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.062318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387eb4-7f73-46fe-8cc3-484e88ac6730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.083605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-92387eb4-7f73-46fe-8cc3-484e88ac6730 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:30.086227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-92387eb4-7f73-46fe-8cc3-484e88ac6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:30.086415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:30.087217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.087507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.087790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.090337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:30.098622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:30.100266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:30.122212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:30.123319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:30.124289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:30.125706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 348/713] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:30.131848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.196429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 366/714] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:30.230127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92387eb4-7f73-46fe-8cc3-484e88ac6730 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.307412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c848-bbbe-405b-bc07-b41733f19212 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:30.352963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92387eb4-7f73-46fe-8cc3-484e88ac6730 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:30.356872 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98359-1996-4bc8-a536-5e8b509c8ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:30.357561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98359-1996-4bc8-a536-5e8b509c8ddb None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.357849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98359-1996-4bc8-a536-5e8b509c8ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.358136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98359-1996-4bc8-a536-5e8b509c8ddb None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.358938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98359-1996-4bc8-a536-5e8b509c8ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:30.359259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98359-1996-4bc8-a536-5e8b509c8ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:30.360749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98359-1996-4bc8-a536-5e8b509c8ddb None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:30.376283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 349/715] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:30.378497 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd5c3-6821-4677-b596-499720c8a7bc None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.378811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd5c3-6821-4677-b596-499720c8a7bc None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.379107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd5c3-6821-4677-b596-499720c8a7bc None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.384648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 350/716] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:30.385728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cd5c3-6821-4677-b596-499720c8a7bc None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.388989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:30.399048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863d651-04f3-4c18-8cd4-b3bde2104dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:30.400087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863d651-04f3-4c18-8cd4-b3bde2104dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.400549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863d651-04f3-4c18-8cd4-b3bde2104dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.400860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863d651-04f3-4c18-8cd4-b3bde2104dc5 None admin] PATH_INFO: `/v3/services/network` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.401579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863d651-04f3-4c18-8cd4-b3bde2104dc5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:30.402953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863d651-04f3-4c18-8cd4-b3bde2104dc5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-6863d651-04f3-4c18-8cd4-b3bde2104dc5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:30.417379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:30.418725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:30.419584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 367/717] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:30 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:30.420596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d0a1e-47bb-44ed-9be7-71915d3a451b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.420804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d0a1e-47bb-44ed-9be7-71915d3a451b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.421086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d0a1e-47bb-44ed-9be7-71915d3a451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.438790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-242d0a1e-47bb-44ed-9be7-71915d3a451b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:30.439989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-242d0a1e-47bb-44ed-9be7-71915d3a451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:30.464536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:30.527131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 368/718] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:30.528078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d0a1e-47bb-44ed-9be7-71915d3a451b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.534572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cd5c3-6821-4677-b596-499720c8a7bc None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:30.592091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:30.593475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.594223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.594751 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.596214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=06274e1b42f6471cac81889ec673a222) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:30.596781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:30.598979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:30.608032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 351/719] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:30 2022] GET /identity/v3/role_assignments?user.id=06274e1b42f6471cac81889ec673a222&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:30.609403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.661547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d0a1e-47bb-44ed-9be7-71915d3a451b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:30.690558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:30.710852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:30.712150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.712706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.713192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.714107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] RBAC: Adding query filter params (name=network) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:30.715030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:30.716958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:30.724213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 369/720] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:30.731737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.735016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dc5c4-e8a3-4a77-881e-7d978b62945f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:30.777913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:30.818138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:30.819026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.819307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.819586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.845606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:30.856872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc1447-a18c-4349-8955-007e6ccd60ac None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:30.862882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:30.863861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:30.864762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 352/721] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:30.871172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:30.900369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:30.901659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:30.902153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:30.902635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:30.903562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] RBAC: Adding query filter params (type=network) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:30.904091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:30.905847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:30.913631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 370/722] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:31.054898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcc4e2-c1da-411d-b82e-18d725eda073 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:31.106583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:31.107199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:31.107482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:31.107766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:31.108530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:31.108868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:31.110281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:31.122815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 353/723] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:31.128944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:31.198723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:31.388522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ce9f-6f3b-4cd5-8cd4-b48e1df00f5a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:31.432630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d0f38-b66a-4b17-86d3-db98e0a64c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:31.433376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d0f38-b66a-4b17-86d3-db98e0a64c0b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:31.433664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d0f38-b66a-4b17-86d3-db98e0a64c0b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:31.433946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d0f38-b66a-4b17-86d3-db98e0a64c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:31.446728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d0f38-b66a-4b17-86d3-db98e0a64c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:31.448208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d0f38-b66a-4b17-86d3-db98e0a64c0b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-3f9d0f38-b66a-4b17-86d3-db98e0a64c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:31.474961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:31.476049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:31.477091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:31.477091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:31.477091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:31.477091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:31.477091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 371/724] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:31.481836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:31.553976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:31.619909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c908-836c-414c-b6a0-2aceef009c26 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:31.619909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c908-836c-414c-b6a0-2aceef009c26 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:31.619909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c908-836c-414c-b6a0-2aceef009c26 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:31.620819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 372/725] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:31.626024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110354c-bccf-4bdf-93fe-cd4621a6276c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:31.626312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110354c-bccf-4bdf-93fe-cd4621a6276c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:31.626593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110354c-bccf-4bdf-93fe-cd4621a6276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:31.633563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909b147-403d-4538-a00b-51490b6b096e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:31.661907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1110354c-bccf-4bdf-93fe-cd4621a6276c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:31.663079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1110354c-bccf-4bdf-93fe-cd4621a6276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:31.670207 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:31.671090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:31.671520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:31.671957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:31.672864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:31.673317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:31.674843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:31.687840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 354/726] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:31.700763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:31.777575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 373/727] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:31.804874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110354c-bccf-4bdf-93fe-cd4621a6276c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:31.839811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:31.888804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:31.897289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f346e2-c9e3-4ad9-8ece-b3112bb2278c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:31.922293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110354c-bccf-4bdf-93fe-cd4621a6276c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:31.964379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:31.965286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:31.965582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:31.965942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:31.979668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:31.981103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:31.981389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:31.981671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:31.982597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:31.998458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:31.999386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:32.000296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:32.001573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 374/728] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:32.002267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:32.018309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:32.031456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:32.032429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:32.034596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 355/729] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:42:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:32.038839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:32.156381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07009e4-cd9a-4ac4-94d6-fd9e762f7c90 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:32.202768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:32.205041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:32.205324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:32.205603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:32.206454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:32.206765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:32.216881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:32.254425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 356/730] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 18 14:42:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:32.259911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:32.288598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:32.300907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:32.306754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cce37-24b6-41c0-bb98-50b1485fe051 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:32.345455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:32.346130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:32.346415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:32.346695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:32.347445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:32.347756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:32.349583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:32.359102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 375/731] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:32.364065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:32.475913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742b67-09eb-45d9-87e0-7cb6c0cdbcbb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:32.514489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:32.515603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:32.515895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:32.516180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:32.529187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:32.530661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:32.530773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069e650-e52b-4a6f-9154-693f6ac9db3b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:32.552087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:32.553151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:32.554601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:32.554601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:32.554601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:32.554601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:32.554601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 376/732] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:32.563248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:32.569239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:32.591364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:32.592035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:32.592329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:32.592622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:32.666874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:32.668357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:32.688116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:32.775855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 357/733] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:32.780776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:32.806724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b1e2-b17a-4c83-9988-5ccdb3fadccd None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:32.869090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cf997-494c-4067-80a9-d493d598d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:32.869838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cf997-494c-4067-80a9-d493d598d568 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:32.870188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cf997-494c-4067-80a9-d493d598d568 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:32.870531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cf997-494c-4067-80a9-d493d598d568 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:32.871315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cf997-494c-4067-80a9-d493d598d568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:32.871690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cf997-494c-4067-80a9-d493d598d568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:32.873244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cf997-494c-4067-80a9-d493d598d568 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:32.885935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 377/734] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:32.887348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832912fe-89fd-40d1-911d-cd5b7d2cc811 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:32.887699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832912fe-89fd-40d1-911d-cd5b7d2cc811 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:32.888046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832912fe-89fd-40d1-911d-cd5b7d2cc811 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:32.893368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 378/735] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:32.894227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832912fe-89fd-40d1-911d-cd5b7d2cc811 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:32.900329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fb949-7419-429e-a7cc-f801283e8d82 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:32.923476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:32.949636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1d88c-1b96-4edf-821d-3917521dd509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:32.951083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1d88c-1b96-4edf-821d-3917521dd509 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:32.951572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1d88c-1b96-4edf-821d-3917521dd509 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:32.952241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1d88c-1b96-4edf-821d-3917521dd509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:32.967134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1d88c-1b96-4edf-821d-3917521dd509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:32.969775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1d88c-1b96-4edf-821d-3917521dd509 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:32.972090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-66b1d88c-1b96-4edf-821d-3917521dd509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:32.993866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:32.994888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:32.995818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:32.995818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:32.995818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:32.995818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:32.998323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 358/736] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:33.000181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be85ae-90d2-419a-b5ca-3c081f2493d7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.000667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be85ae-90d2-419a-b5ca-3c081f2493d7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.001383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be85ae-90d2-419a-b5ca-3c081f2493d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.021112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832912fe-89fd-40d1-911d-cd5b7d2cc811 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.022033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e9be85ae-90d2-419a-b5ca-3c081f2493d7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:33.023540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e9be85ae-90d2-419a-b5ca-3c081f2493d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:33.062974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.064009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.064439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.064880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] PATH_INFO: `/v3/users/swift` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.073342 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:33.075436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:33.094475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:33.095686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:33.096891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:33.099425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 379/737] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:33.101084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.112807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 359/738] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:33.113973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be85ae-90d2-419a-b5ca-3c081f2493d7 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.215384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5f77-9afb-446f-8cb2-8f2d1521fddb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.236194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:33.239277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:33.242259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be85ae-90d2-419a-b5ca-3c081f2493d7 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.251390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ec964-dedf-4e6a-beb5-7fdcfa32ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.252059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec964-dedf-4e6a-beb5-7fdcfa32ec9a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.252347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec964-dedf-4e6a-beb5-7fdcfa32ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.252649 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec964-dedf-4e6a-beb5-7fdcfa32ec9a None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.253384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec964-dedf-4e6a-beb5-7fdcfa32ec9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:33.253694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec964-dedf-4e6a-beb5-7fdcfa32ec9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:33.255066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec964-dedf-4e6a-beb5-7fdcfa32ec9a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:33.266568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 380/739] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:33.267812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9b98-3636-4053-b67b-15c2f6ff44cd None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.268101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9b98-3636-4053-b67b-15c2f6ff44cd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.268380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9b98-3636-4053-b67b-15c2f6ff44cd None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.272628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 381/740] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:33.272628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c9b98-3636-4053-b67b-15c2f6ff44cd None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.286881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.288088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.288373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.288687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.289527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:33.289907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:33.291497 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:33.310615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 360/741] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:33.311431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.379918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c9b98-3636-4053-b67b-15c2f6ff44cd None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.413906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ec148-45ee-4fa8-91d1-0c700232ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.414840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec148-45ee-4fa8-91d1-0c700232ba5f None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.415124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec148-45ee-4fa8-91d1-0c700232ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.415401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ec148-45ee-4fa8-91d1-0c700232ba5f None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.415712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1a335-8c49-453e-b67a-90804128910f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.416120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec148-45ee-4fa8-91d1-0c700232ba5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:33.417517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ec148-45ee-4fa8-91d1-0c700232ba5f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:33.440282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 382/742] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:42:33 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:33.440282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1626c2-433d-400e-a426-5230b76db0e3 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.440282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1626c2-433d-400e-a426-5230b76db0e3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.440282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1626c2-433d-400e-a426-5230b76db0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.454370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0a1626c2-433d-400e-a426-5230b76db0e3 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:33.455679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0a1626c2-433d-400e-a426-5230b76db0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:33.476997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.477923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.478275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.478617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.487428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:33.489210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:33.510719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:33.511940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:33.513090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:33.514654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 361/743] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:33.515320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:33.515796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.546749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:33.556695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 383/744] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:33.556695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1626c2-433d-400e-a426-5230b76db0e3 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.692483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7be3-53a4-4525-b342-d6d6eebae0ee None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.707377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1626c2-433d-400e-a426-5230b76db0e3 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.734300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949e4f-8b2d-4c75-be39-ab7b98e331db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.735104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949e4f-8b2d-4c75-be39-ab7b98e331db None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.735721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949e4f-8b2d-4c75-be39-ab7b98e331db None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.736010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949e4f-8b2d-4c75-be39-ab7b98e331db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.744224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.745447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.745744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.746033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.747284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:33.747611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:33.749760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:33.762739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 384/745] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:33.763575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.805237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:33.814701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949e4f-8b2d-4c75-be39-ab7b98e331db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:33.816176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949e4f-8b2d-4c75-be39-ab7b98e331db None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:33.830996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:33.877487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb0e20-29d2-496a-9da2-34ec295aa30f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:33.915837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:33.917476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.918193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.919068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.921428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 362/746] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 14:42:33.922765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572dd0a-4e49-436f-90f2-de9344b58089 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:33.923059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572dd0a-4e49-436f-90f2-de9344b58089 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:33.923340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572dd0a-4e49-436f-90f2-de9344b58089 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:33.924920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 363/747] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:33.929365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572dd0a-4e49-436f-90f2-de9344b58089 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:33.938427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:33.949052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:33.950194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:33.951218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:33.953769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 385/748] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:33.954627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.044112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572dd0a-4e49-436f-90f2-de9344b58089 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.053847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:34.059975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:34.062273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60848d-3261-480b-baf2-3c28956d4a49 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.083693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f7f69-3ed0-416e-9886-f3858bec3789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.085006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f7f69-3ed0-416e-9886-f3858bec3789 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.085220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f7f69-3ed0-416e-9886-f3858bec3789 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.085503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f7f69-3ed0-416e-9886-f3858bec3789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.086328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f7f69-3ed0-416e-9886-f3858bec3789 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=45668b6b20b644689d57844dc6b77ef1) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:34.086644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f7f69-3ed0-416e-9886-f3858bec3789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.088084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f7f69-3ed0-416e-9886-f3858bec3789 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.094337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 364/749] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/role_assignments?user.id=45668b6b20b644689d57844dc6b77ef1&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:34.095318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe258ff-c136-48dd-9511-84cb815c3595 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.095607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe258ff-c136-48dd-9511-84cb815c3595 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.095884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe258ff-c136-48dd-9511-84cb815c3595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.107752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.108976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.109464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.109936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.120711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-7fe258ff-c136-48dd-9511-84cb815c3595 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:34.122772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7fe258ff-c136-48dd-9511-84cb815c3595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:34.124951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.126974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:34.151787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:34.152795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:34.153700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:34.153700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:34.153700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:34.153700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:34.156496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 386/750] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:34.157602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.228438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 365/751] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 14:42:34.229847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe258ff-c136-48dd-9511-84cb815c3595 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.309758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20e628-5547-48cc-9bae-85ee1e5de95b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.345814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.346840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.347353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.347836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.348834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:34.349360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.350972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.359863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 387/752] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:34.360954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.362389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe258ff-c136-48dd-9511-84cb815c3595 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.373420 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:34.376483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:34.411682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.412523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.412889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.413232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.414309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:34.414689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.416642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.433649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 366/753] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:34.434889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.475537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67394c-b146-4d66-b0eb-c866bae432c3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.512158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.513189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.513661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.514122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.515042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.516609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.536948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 388/754] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:42:34 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:34.538826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.559618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ace7-926a-4ddf-ad44-e7b02c566576 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.610901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.611880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.612259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.612651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.625286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.627078 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:34.647395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:34.648628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:34.649779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:34.649779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:34.649779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:34.649779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:34.651711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 367/755] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:34.657717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.686644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:34.710617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:34.761469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa47781-6c97-47d5-b78f-92377cad0413 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.804442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.805297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.805574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.805854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.813071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.814583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:34.832790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:34.833735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:34.834765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:34.835207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 389/756] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:34.837980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4585ec-ed83-435e-85fa-132730c5ce80 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:34.842001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.876260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:34.876986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:34.877268 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:34.877548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:34.878270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:34.878578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:34.879960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:34.893363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 368/757] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:34.901656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:34.974240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58204de6-b85e-4d27-937f-35614b9f02d2 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:35.013326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:35.016993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:35.028844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:35.029523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:35.029811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:35.030095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:35.030891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:35.031207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:35.032663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:35.053366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 390/758] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:35.057065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdadcc-718c-433b-bba3-1e52bce61b86 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:35.061002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:35.131778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:35.132603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:35.132892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:35.133171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:35.149354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:35.150843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:35.176773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:35.177833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:35.178807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:35.189064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 369/759] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:42:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:35.195495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:35.232835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979400-5188-4028-b6c3-57f253d4b0a2 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:35.291920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:35.292515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:35.292834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:35.293115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:35.294208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=f2c1ef0b6b3241a19397b8696c05fc99) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:35.294529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:35.296076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:35.303304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 391/760] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:35 2022] GET /identity/v3/role_assignments?user.id=f2c1ef0b6b3241a19397b8696c05fc99&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:35.347536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a415c3-0cb9-4a3d-954c-fe485773be57 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:35.399724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:35.400724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:35.401185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:35.401609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:35.402629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:35.403111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:35.404803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:35.408159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:35.429610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 370/761] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:42:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:35.436646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:35.544826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:35.620445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f32d-b147-4385-b965-42b6918b7339 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:35.660669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:35.661488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:35.661772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:35.662052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:35.673467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:35.674943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:35.692507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:35.694001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:35.694912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:35.694912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:35.694912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:35.694912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:35.694912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 392/762] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:35.699770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:35.833332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f71c-23a4-467c-b5ec-f331925801ab None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:35.887203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0628d2-8c73-4bd1-bdfe-4e8154d11dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:35.887884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0628d2-8c73-4bd1-bdfe-4e8154d11dd3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:35.888172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0628d2-8c73-4bd1-bdfe-4e8154d11dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:35.888454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0628d2-8c73-4bd1-bdfe-4e8154d11dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:35.889206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0628d2-8c73-4bd1-bdfe-4e8154d11dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:35.889518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0628d2-8c73-4bd1-bdfe-4e8154d11dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:35.890918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0628d2-8c73-4bd1-bdfe-4e8154d11dd3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:35.907433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 371/763] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:35.912516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:36.048439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402628-138a-4e33-86a5-df1e483809b8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:36.051153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:36.097226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:36.097944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.098232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.098579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.106248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:36.107701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:36.124386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:36.125350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:36.126255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 393/764] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:36.130698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad029e-d070-41d1-8f2b-722f58e12e7b None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.131173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad029e-d070-41d1-8f2b-722f58e12e7b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.131362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad029e-d070-41d1-8f2b-722f58e12e7b None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.132789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 372/765] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:36.133530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:36.138927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af5e9-2977-4ac4-9374-85c660470787 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.139466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af5e9-2977-4ac4-9374-85c660470787 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.140057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af5e9-2977-4ac4-9374-85c660470787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.170393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-de3af5e9-2977-4ac4-9374-85c660470787 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:36.171789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-de3af5e9-2977-4ac4-9374-85c660470787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:36.233046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:36.263129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 373/766] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:36.301887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af5e9-2977-4ac4-9374-85c660470787 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:36.326374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a22d-3749-47ce-bea2-0f2d05585cd3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:36.414721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:36.415310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.415591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.415864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.416675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:36.416986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:36.418410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:36.429364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af5e9-2977-4ac4-9374-85c660470787 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:36.454554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 394/767] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:36.469464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:36.471303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:36.472122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.472410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.472887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.473612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:36.475717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:36.494381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:36.495374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:36.496225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 374/768] 10.222.0.59 () {56 vars in 1129 bytes} [Wed May 18 14:42:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:36.501493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:36.534270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:36.588939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:36.671123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315f807-2663-4946-ad9b-2d68f5dabd18 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:36.674546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582bc33-e277-4798-878f-5d1ca873d621 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:36.735428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a9f88-0975-4bb0-887d-ca3199b0d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:36.736435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9f88-0975-4bb0-887d-ca3199b0d443 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.736750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9f88-0975-4bb0-887d-ca3199b0d443 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.737028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9f88-0975-4bb0-887d-ca3199b0d443 None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/06274e1b42f6471cac81889ec673a222/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.739001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a9f88-0975-4bb0-887d-ca3199b0d443 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=06274e1b42f6471cac81889ec673a222, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:36.740484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a9f88-0975-4bb0-887d-ca3199b0d443 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:36.745929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf141a9-30f9-4347-8ae0-0f11534ec992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:36.746620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf141a9-30f9-4347-8ae0-0f11534ec992 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.747056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf141a9-30f9-4347-8ae0-0f11534ec992 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.747301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf141a9-30f9-4347-8ae0-0f11534ec992 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.748046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf141a9-30f9-4347-8ae0-0f11534ec992 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:36.748359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf141a9-30f9-4347-8ae0-0f11534ec992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:36.751258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf141a9-30f9-4347-8ae0-0f11534ec992 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:36.756194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 375/769] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 18 14:42:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:36.760601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493d66-ce8b-4c69-a8d8-05ba80774eb8 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.762480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493d66-ce8b-4c69-a8d8-05ba80774eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.762480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493d66-ce8b-4c69-a8d8-05ba80774eb8 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.762480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 376/770] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:36.763051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7493d66-ce8b-4c69-a8d8-05ba80774eb8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:36.766776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 395/771] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:36 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/06274e1b42f6471cac81889ec673a222/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:36.768131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec3ff1-60fe-488c-905d-d864be1af4af None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:36.768430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec3ff1-60fe-488c-905d-d864be1af4af None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:36.768743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec3ff1-60fe-488c-905d-d864be1af4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:36.797181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e7ec3ff1-60fe-488c-905d-d864be1af4af None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:36.798424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e7ec3ff1-60fe-488c-905d-d864be1af4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:36.939657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 396/772] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:36.972848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7493d66-ce8b-4c69-a8d8-05ba80774eb8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:36.986507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec3ff1-60fe-488c-905d-d864be1af4af None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:36.988770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:37.008170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:37.023466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.024518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.025098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.025672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.026757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:37.027266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:37.029441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:37.036377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 377/773] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 18 14:42:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:37.049492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:37.123047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec3ff1-60fe-488c-905d-d864be1af4af None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:37.192772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.194075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.194358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.194638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.217873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:37.228274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:37.229302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:37.230490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 397/774] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:37.236572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:37.237435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dcbb8-950d-4f07-a244-8db5c6c8ce74 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:37.295266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ab95-6179-463c-bfd1-a7ee58c3066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.295945 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ab95-6179-463c-bfd1-a7ee58c3066a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.296228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ab95-6179-463c-bfd1-a7ee58c3066a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.296555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ab95-6179-463c-bfd1-a7ee58c3066a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.297487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ab95-6179-463c-bfd1-a7ee58c3066a None admin] RBAC: Adding query filter params (interface=public, service_id=30c2dea4f38744269b86630d829cc946, region_id=RegionOne) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:37.297808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ab95-6179-463c-bfd1-a7ee58c3066a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:37.299196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ab95-6179-463c-bfd1-a7ee58c3066a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:37.308382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 378/775] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/endpoints?service_id=30c2dea4f38744269b86630d829cc946&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:37.309840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a895a2f-6c05-41a5-9646-73b48cfbee8b None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.310132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a895a2f-6c05-41a5-9646-73b48cfbee8b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.310413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a895a2f-6c05-41a5-9646-73b48cfbee8b None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.311969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 379/776] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:37.316305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a895a2f-6c05-41a5-9646-73b48cfbee8b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:37.351002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:37.378696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:37.378879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b14a1-20f4-4b27-af50-22059607f1ea None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:37.421978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51894aed-223e-4e8a-a0f8-eec066a5e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.423126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51894aed-223e-4e8a-a0f8-eec066a5e7de None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.424336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51894aed-223e-4e8a-a0f8-eec066a5e7de None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.424889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51894aed-223e-4e8a-a0f8-eec066a5e7de None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.429500 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51894aed-223e-4e8a-a0f8-eec066a5e7de None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:37.429822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51894aed-223e-4e8a-a0f8-eec066a5e7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:37.431794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51894aed-223e-4e8a-a0f8-eec066a5e7de None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:37.444742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 398/777] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:37.446580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624cf7-b7ff-4f8b-b1c0-80d8531b9b59 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.447075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624cf7-b7ff-4f8b-b1c0-80d8531b9b59 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.447566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624cf7-b7ff-4f8b-b1c0-80d8531b9b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.463525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a895a2f-6c05-41a5-9646-73b48cfbee8b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:37.467307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a3624cf7-b7ff-4f8b-b1c0-80d8531b9b59 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:37.468829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a3624cf7-b7ff-4f8b-b1c0-80d8531b9b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:37.499178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.499858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.500132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.500411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.501128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:37.502773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:37.512619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 380/778] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:37.512619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:37.570015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 399/779] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:37.650121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3624cf7-b7ff-4f8b-b1c0-80d8531b9b59 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:37.662005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d94e5-bbb9-40ef-bac2-03baa5534b56 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:37.664951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:37.719571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.720836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.721423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.721920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.736450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:37.738264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:37.753022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:37.761668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:37.762621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:37.763526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:37.763526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:37.763526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:37.763526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:37.765637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 381/780] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:37.772400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:37.822560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3624cf7-b7ff-4f8b-b1c0-80d8531b9b59 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:37.894815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ac19-0009-4055-b8a5-119f3e0e86cb None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:37.925878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.926688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.926969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.927243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] PATH_INFO: `/v3/services/network` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.928436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:37.929830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:37.935809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:37.936725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:37.937192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:37.937671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:37.938745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:37.939240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:37.940824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:37.956092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 382/781] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:37.960620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:37.961615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:37.962471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 400/782] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:37.965879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:37.966840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.001488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.128425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c8d35-ffe5-4442-9084-1914c1adcf65 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.129919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b656b-bbaf-4211-99c0-e6e3ef24c995 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.164072 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.165842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.166661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.166938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.167192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.171015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563426a-a6eb-43dd-92f0-195542c8aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.171872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563426a-a6eb-43dd-92f0-195542c8aed9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.172334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563426a-a6eb-43dd-92f0-195542c8aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.172653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563426a-a6eb-43dd-92f0-195542c8aed9 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.173375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563426a-a6eb-43dd-92f0-195542c8aed9 None admin] RBAC: Adding query filter params (name=network) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:38.173689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563426a-a6eb-43dd-92f0-195542c8aed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.175071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563426a-a6eb-43dd-92f0-195542c8aed9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.175252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.176714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.180968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 401/783] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:38.182326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3a1c-426f-468c-af9d-91b2581b3112 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.182622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3a1c-426f-468c-af9d-91b2581b3112 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.182907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3a1c-426f-468c-af9d-91b2581b3112 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.188516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 402/784] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:38.189833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f837d6-52a7-493d-a1c8-7f756bcea55b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.190128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f837d6-52a7-493d-a1c8-7f756bcea55b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.190408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f837d6-52a7-493d-a1c8-7f756bcea55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:38.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:38.205856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 383/785] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:42:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:38.208304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.209931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e7f837d6-52a7-493d-a1c8-7f756bcea55b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:38.209931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e7f837d6-52a7-493d-a1c8-7f756bcea55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:38.297987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.301069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 403/786] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:38.302222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f837d6-52a7-493d-a1c8-7f756bcea55b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.331885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827292-4fec-4e8a-9ed2-2f4f5ce818dd None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.382479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.383324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.384107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.384494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.385371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] RBAC: Adding query filter params (type=network) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:38.386126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.387947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.394782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 384/787] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:38.395672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.410095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f837d6-52a7-493d-a1c8-7f756bcea55b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.437727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.453088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.453852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.454138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.454476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.455324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:38.455638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.457119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.482520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 404/788] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:38.483384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.522838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986cf19-2dce-44d8-9059-64645244c668 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.563410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.564135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.564420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.565355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.576555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.580897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:38.591885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:38.592897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:38.593836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:38.594490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 385/789] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:38.595878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.612309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818e5a-d200-4ddf-a961-2a6b1c7ef6ef None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.648737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.649428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.649713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.649993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.650787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] RBAC: Adding query filter params (interface=public, service_id=f0b5b93b06e94eb38bb44038b1bfc271, region_id=RegionOne) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:38.651102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.652562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.661881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 405/790] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/endpoints?service_id=f0b5b93b06e94eb38bb44038b1bfc271&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:38.663302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.713552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.738119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289835f-1b1d-445b-b379-3395c6e5ca83 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.774240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385ed5-b60d-48d2-a581-33be9054c0b9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.775661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.776765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.777260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.777742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.789381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.791176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:38.811149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:38.812121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:38.813075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:38.813075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:38.813075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:38.813075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:38.813313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.813313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.813313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.813313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.814114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:38.814114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.815465 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.816335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 386/791] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:38.818057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.830440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 406/792] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:38.831357 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.926095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea406b-1d64-4de2-8ad3-627a60d21c93 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.928899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.936771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d03390-67ea-42cc-92dc-959dfe40a985 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:38.948020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:38.963100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.964121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.964742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.965230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.966114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.967704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.973872 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 387/793] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:38.975108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:38.976744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:38.977429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:38.977715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:38.977997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:38.978741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:38.979052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:38.981476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:38.994901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 407/794] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:39.000684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:39.116410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa185248-3708-40f2-a364-d1972af17e10 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:39.118428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bcc5-0fe6-4f2a-9497-5e948af9a80c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:39.158495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:39.168493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:39.169651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.169937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.170214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.178729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:39.180199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:39.195305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:39.196280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:39.197222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 408/795] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:39.203468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:39.211603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:39.212427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.212734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.213012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.236648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:39.236648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:39.251751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:39.261279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:39.262465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:39.263442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:39.263442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:39.263442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:39.263442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:39.263442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 388/796] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:39.269603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:39.376297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fe376-733f-43c7-8eee-0dbf5adc0b9d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:39.439205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36d696-1db0-4289-bc87-ee042a20c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:39.440856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d696-1db0-4289-bc87-ee042a20c0ac None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.441294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d696-1db0-4289-bc87-ee042a20c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.441716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d696-1db0-4289-bc87-ee042a20c0ac None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.442655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d696-1db0-4289-bc87-ee042a20c0ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:39.443057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8a96-cd06-4ce6-9722-0207de66ba12 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:39.443666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d696-1db0-4289-bc87-ee042a20c0ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:39.446476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d696-1db0-4289-bc87-ee042a20c0ac None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:39.463767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 409/797] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:39.470099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e1a8-514b-4e4a-9d5a-bfd8396ad89f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.470099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e1a8-514b-4e4a-9d5a-bfd8396ad89f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.470099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e1a8-514b-4e4a-9d5a-bfd8396ad89f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.472268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 410/798] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:39.475177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09e1a8-514b-4e4a-9d5a-bfd8396ad89f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:39.492673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c559b-ca75-4933-a32b-9d4c5a239916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:39.493772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c559b-ca75-4933-a32b-9d4c5a239916 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.494275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c559b-ca75-4933-a32b-9d4c5a239916 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.494757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c559b-ca75-4933-a32b-9d4c5a239916 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.495784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c559b-ca75-4933-a32b-9d4c5a239916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:39.496315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c559b-ca75-4933-a32b-9d4c5a239916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:39.497994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c559b-ca75-4933-a32b-9d4c5a239916 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:39.512596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 389/799] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:39.514573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7962c-5885-426c-96a8-0f6ba2d40d06 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.515065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7962c-5885-426c-96a8-0f6ba2d40d06 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.515543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7962c-5885-426c-96a8-0f6ba2d40d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.532916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e8a7962c-5885-426c-96a8-0f6ba2d40d06 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:39.534483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e8a7962c-5885-426c-96a8-0f6ba2d40d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:39.560823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:39.570388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:39.583763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09e1a8-514b-4e4a-9d5a-bfd8396ad89f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:39.619352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:39.619733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 390/800] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:39.620181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.620763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.621137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/45668b6b20b644689d57844dc6b77ef1/roles/b26281de225b480090083648f097a6d2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.621431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7962c-5885-426c-96a8-0f6ba2d40d06 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:39.637726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=45668b6b20b644689d57844dc6b77ef1, role_id=b26281de225b480090083648f097a6d2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:39.639318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:39.657597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 411/801] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:39 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/45668b6b20b644689d57844dc6b77ef1/roles/b26281de225b480090083648f097a6d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:39.671799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:39.754580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7962c-5885-426c-96a8-0f6ba2d40d06 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:39.794292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:39.795486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.795968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.796526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.805762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:39.807849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:39.825490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a95c51-1bbf-46af-b877-00c9f703bbac None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:39.825920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:39.826825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:39.827787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:39.830533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 391/802] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:39.841805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:39.867528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:39.877118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:39.877118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:39.877118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:39.878102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:39.882416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:39.883459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:39.893125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:39.894121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:39.894966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:39.899485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 412/803] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:39.907955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.030507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b5d95-5fbb-474f-be0f-ee2c9876523f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.053289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d024e1-70a8-4ed2-9907-a29b5ee54234 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.077365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b6247-3505-49cf-b178-2ba19067634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.078117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b6247-3505-49cf-b178-2ba19067634a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.078407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b6247-3505-49cf-b178-2ba19067634a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.078687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b6247-3505-49cf-b178-2ba19067634a None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.079539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b6247-3505-49cf-b178-2ba19067634a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:40.079850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b6247-3505-49cf-b178-2ba19067634a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.081339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b6247-3505-49cf-b178-2ba19067634a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.102037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b331a98-4b2e-479e-bb9f-5f56b08b2ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.102715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b331a98-4b2e-479e-bb9f-5f56b08b2ffd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.103000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b331a98-4b2e-479e-bb9f-5f56b08b2ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.103279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b331a98-4b2e-479e-bb9f-5f56b08b2ffd None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.104031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b331a98-4b2e-479e-bb9f-5f56b08b2ffd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:40.104341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b331a98-4b2e-479e-bb9f-5f56b08b2ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.105765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b331a98-4b2e-479e-bb9f-5f56b08b2ffd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.108757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 392/804] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 18 14:42:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:40.110164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2efd1-e8f2-453f-838c-e435a1384bea None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.110457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2efd1-e8f2-453f-838c-e435a1384bea None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.110740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2efd1-e8f2-453f-838c-e435a1384bea None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.112272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 393/805] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:40.114469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2efd1-e8f2-453f-838c-e435a1384bea None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.114858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 413/806] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:40.120607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22f8b-5530-4a9d-9436-b419461e582e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.120922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22f8b-5530-4a9d-9436-b419461e582e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.121211 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22f8b-5530-4a9d-9436-b419461e582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.142091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-97c22f8b-5530-4a9d-9436-b419461e582e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:40.143466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-97c22f8b-5530-4a9d-9436-b419461e582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:40.200615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:40.204873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:40.217157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 414/807] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:40.223727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2efd1-e8f2-453f-838c-e435a1384bea None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.225419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c22f8b-5530-4a9d-9436-b419461e582e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.260562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.261403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.261685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.261965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.273000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.274468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:40.297614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:40.298584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:40.299496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:40.299496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:40.299496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:40.299496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:40.300029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 394/808] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:40.304969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.353898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c22f8b-5530-4a9d-9436-b419461e582e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.391387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.392194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.392477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.392883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.404333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.405770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.422611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336040f4-d9b2-4802-b2cd-f7907fc91fec None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:40.424133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:40.425083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:40.426091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:40.426091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:40.426091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:40.426091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:40.431965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 415/809] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:40.432869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.458928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:40.471508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.472619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.473051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.473490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.474353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.475989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.488929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:40.490700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:40.491880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 14:42:40.492926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:40.498970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 395/810] 10.222.0.59 () {56 vars in 1129 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:40.499972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.564397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed8df7-b174-439f-966b-8ca6120206ba None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.611628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.612313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.612618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.612913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.613893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:40.614213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.616885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.618475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5ddf8-85f3-48c3-bc0e-4eee33c53fc4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.632665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 416/811] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:40.633729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.666719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.667754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.667996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.668280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.669567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:40.669883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.671272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.692623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 396/812] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:40.692623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.747398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b20b4-daa2-427d-8303-2faf563b7643 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.749365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:40.759992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:40.788960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.789914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.790393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.790844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.791803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:40.792269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.794060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.804655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 417/813] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:40.805816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.816214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc7bee-abbc-440e-99c8-9a9f800b0f39 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.858001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.859057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.859057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.859342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.866820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.868294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:40.882807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:40.883915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:40.884995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:40.888892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 397/814] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:40.889612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:40.922495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14727e0-5dc7-44e9-bfb0-41c70fbde3e9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:40.961934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:40.963087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:40.963515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:40.963936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:40.972874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:40.974835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:40.991530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:40.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:42:40.993758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:40.994293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63098cd1-16cb-4d03-b23b-017dc7f704a3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.000557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 418/815] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:41.001712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.007693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:41.029409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.030079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.030363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.030643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.031352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:41.031650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:41.033067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:41.036347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:41.042867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 398/816] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 18 14:42:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:41.042867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.127915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd3f2-749d-4651-9cd2-1ba3461ead25 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.143888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350f49-2a94-43b5-951f-2c76e0184603 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.166288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.167441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.167874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.168298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.169512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:41.170181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:41.171881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:41.178979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.179598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.179882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.180161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.181030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:41.181695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:41.182787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:41.187666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 419/817] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:41.188721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.211200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 399/818] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:42:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:41.211200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.241905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:41.295175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:41.314929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7a784-c894-46e1-b55c-54fa500dffb3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.316261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04049c4-cd3f-4418-b7bd-640e24fa0284 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.351335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.352228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.352621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.352911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/f2c1ef0b6b3241a19397b8696c05fc99/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.353504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b2ed0-1102-4b02-ac27-337c47af201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.354316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b2ed0-1102-4b02-ac27-337c47af201a None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.354743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b2ed0-1102-4b02-ac27-337c47af201a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.354911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=f2c1ef0b6b3241a19397b8696c05fc99, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:41.355320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b2ed0-1102-4b02-ac27-337c47af201a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.356203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b2ed0-1102-4b02-ac27-337c47af201a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:41.356367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:41.357860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b2ed0-1102-4b02-ac27-337c47af201a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:41.380912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 400/819] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:41 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/f2c1ef0b6b3241a19397b8696c05fc99/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:41.381912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.391152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 420/820] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:42:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:41.469628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bfbf7-47c7-4afa-abdd-cf2d906365ac None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.469942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bfbf7-47c7-4afa-abdd-cf2d906365ac None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.470231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bfbf7-47c7-4afa-abdd-cf2d906365ac None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.472116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 421/821] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:41.478692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307a9f-9cd4-4fd8-baf3-7ee7bc0e7800 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.479163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307a9f-9cd4-4fd8-baf3-7ee7bc0e7800 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.479558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307a9f-9cd4-4fd8-baf3-7ee7bc0e7800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.512780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-31307a9f-9cd4-4fd8-baf3-7ee7bc0e7800 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:41.514041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-31307a9f-9cd4-4fd8-baf3-7ee7bc0e7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:41.520034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:41.530006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573327b-5f62-4edc-b89d-6e941f7abf9c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.587286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.587964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.588326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.588521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.636410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 422/822] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:41.667754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31307a9f-9cd4-4fd8-baf3-7ee7bc0e7800 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.689047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:41.690562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:41.747373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:41.781496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31307a9f-9cd4-4fd8-baf3-7ee7bc0e7800 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.798940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:41.811810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 401/823] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:42:41.817019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.831186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.831995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.832282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.832574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:41.833276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:41.835284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:41.851880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:41.852979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 14:42:41.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:41.854631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 423/824] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:41 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:41.860767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:41.947125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2303-37d4-4380-937f-54340e0d66eb None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.976679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd91801-7c5c-4c72-ad39-95f634df64d3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:41.991535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:41.992610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:41.992819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:41.993046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.004156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.005792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.014567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.015551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.016042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.016526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.017586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] RBAC: Adding query filter params (name=network) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:42.018131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.019694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.022397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:42.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:42.026895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:42.027947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:42.027947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:42.027947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:42.027947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:42.028222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 424/825] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:42.034962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 402/826] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:42.040850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:42.041351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:42.124984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:42.186344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988e356-17c5-4748-b9ef-75cc02bc4af6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:42.232406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.234662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb40ab-a2d7-4fd5-8eee-eada5fd5b6e6 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:42.236787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.237070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.237358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.238092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] RBAC: Adding query filter params (type=network) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:42.238406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.239859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.261429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 425/827] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:42.264175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:42.309365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6423efa-0bad-43ae-b049-0ea4fe6f1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.310044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6423efa-0bad-43ae-b049-0ea4fe6f1e83 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.310327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6423efa-0bad-43ae-b049-0ea4fe6f1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.310608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6423efa-0bad-43ae-b049-0ea4fe6f1e83 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.311340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6423efa-0bad-43ae-b049-0ea4fe6f1e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:42.311653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6423efa-0bad-43ae-b049-0ea4fe6f1e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.313093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6423efa-0bad-43ae-b049-0ea4fe6f1e83 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.333793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 403/828] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:42.335997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3440e-aff7-48a0-9af6-daf6b308d3fe None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.335997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3440e-aff7-48a0-9af6-daf6b308d3fe None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.336323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3440e-aff7-48a0-9af6-daf6b308d3fe None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.345877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 404/829] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:42.345877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3440e-aff7-48a0-9af6-daf6b308d3fe None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:42.381617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:42.416031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4386eeb-84da-4726-a2bc-6b7342100425 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:42.459810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed3255-b782-4e4f-a4d3-9db2ce206e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.460684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed3255-b782-4e4f-a4d3-9db2ce206e00 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.461074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed3255-b782-4e4f-a4d3-9db2ce206e00 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.461518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed3255-b782-4e4f-a4d3-9db2ce206e00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.462288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3440e-aff7-48a0-9af6-daf6b308d3fe None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:42.462446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed3255-b782-4e4f-a4d3-9db2ce206e00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.464141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:42.464262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed3255-b782-4e4f-a4d3-9db2ce206e00 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.493094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 426/830] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:42:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:42.494982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d3de-e51b-41ff-afb4-01cd89e57e78 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.495444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d3de-e51b-41ff-afb4-01cd89e57e78 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.495833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d3de-e51b-41ff-afb4-01cd89e57e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.511122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.512324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.512848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.513265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.521991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.524229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.533915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a921d3de-e51b-41ff-afb4-01cd89e57e78 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:42.535361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a921d3de-e51b-41ff-afb4-01cd89e57e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:42.541104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:42.542149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:42.543119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:42.545864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 405/831] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:42.551603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:42.667574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d222af-b87d-40a9-907a-02e464948d8f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:42.676348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 427/832] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:42.707149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.708287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.708860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.709370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.710385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:42.710927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.712681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.717625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d3de-e51b-41ff-afb4-01cd89e57e78 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:42.726928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 406/833] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:42.733137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:42.759864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:42.833081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:42.873285 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30cc0-2d1f-4165-bd34-9473a3927a89 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:42.901135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d3de-e51b-41ff-afb4-01cd89e57e78 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:42.918987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.919900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.920188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.920871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.921717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=06274e1b42f6471cac81889ec673a222) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:42.922030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:42.923478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:42.935032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 407/834] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:42 2022] GET /identity/v3/role_assignments?user.id=06274e1b42f6471cac81889ec673a222&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:42.953804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:42.954636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:42.954921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:42.955200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:42.968505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:42.977163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:42.978205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:42.979077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 428/835] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:42.984693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:43.102163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:43.124790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c32b07-855f-4e45-8ba6-13cd996ebf21 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:43.161019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:43.161695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:43.162499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:43.162776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:43.163513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:43.163817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:43.165219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:43.176682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 408/836] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:43.180129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:43.300831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567955ed-dbbe-48e3-adb4-638367ffd427 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:43.316808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:43.342672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:43.343476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:43.343762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:43.344040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:43.355537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:43.356958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:43.374313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:43.375223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:43.376371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:43.376371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:43.376371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:43.376371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:43.376371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 429/837] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:43.382545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:43.486458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e733-9640-4915-bacb-fc58e439c5a3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:43.521128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:43.522704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:43.523609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:43.524081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:43.525018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:43.525541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:43.527105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:43.544681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 409/838] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:43.546584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:43.651594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f445d-f02a-4ecd-a1b5-c41bcc5ac859 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:43.686667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:43.687831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:43.688311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:43.688813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:43.697192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:43.698888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:43.714940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:43.715947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:43.716911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:43.723815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 430/839] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:42:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:43.725493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:43.729562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:43.832449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c0ee-4879-4db3-a12e-0b673e295cdc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:43.871409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bffc2-45de-4624-83e3-41b163aef12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:43.872092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bffc2-45de-4624-83e3-41b163aef12a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:43.872380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bffc2-45de-4624-83e3-41b163aef12a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:43.872689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bffc2-45de-4624-83e3-41b163aef12a None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:43.873537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bffc2-45de-4624-83e3-41b163aef12a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:43.873853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bffc2-45de-4624-83e3-41b163aef12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:43.875309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bffc2-45de-4624-83e3-41b163aef12a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:43.894095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 410/840] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 18 14:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:43.900207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:43.926677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.009351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8c97-358e-4b0d-9959-33692d78da9f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.029104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be3671-4df3-4695-b382-c3628a1f8d9a None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.029446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be3671-4df3-4695-b382-c3628a1f8d9a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.029678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be3671-4df3-4695-b382-c3628a1f8d9a None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.031366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 411/841] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:44.037106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187bd78-0791-4e9a-889f-5dd9351c0a74 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.037402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187bd78-0791-4e9a-889f-5dd9351c0a74 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.037690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187bd78-0791-4e9a-889f-5dd9351c0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.053233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02cecb-ebed-4f08-a60c-661f12dd8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.053897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02cecb-ebed-4f08-a60c-661f12dd8845 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.054182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02cecb-ebed-4f08-a60c-661f12dd8845 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.054456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02cecb-ebed-4f08-a60c-661f12dd8845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.055824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-0187bd78-0791-4e9a-889f-5dd9351c0a74 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:44.057062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0187bd78-0791-4e9a-889f-5dd9351c0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:44.117203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.124858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02cecb-ebed-4f08-a60c-661f12dd8845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.126319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02cecb-ebed-4f08-a60c-661f12dd8845 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.136823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 412/842] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:44.151925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.154157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187bd78-0791-4e9a-889f-5dd9351c0a74 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.243426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 431/843] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:42:44.243426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db75410-797e-4d78-a692-b42b4bd2983b None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.243426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db75410-797e-4d78-a692-b42b4bd2983b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.243426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db75410-797e-4d78-a692-b42b4bd2983b None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.243426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 432/844] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:44.244615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db75410-797e-4d78-a692-b42b4bd2983b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.279881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187bd78-0791-4e9a-889f-5dd9351c0a74 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.317959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d70b9-28c0-463e-94f5-03db18a2c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.318802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d70b9-28c0-463e-94f5-03db18a2c481 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.319085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d70b9-28c0-463e-94f5-03db18a2c481 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.319360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d70b9-28c0-463e-94f5-03db18a2c481 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.329843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d70b9-28c0-463e-94f5-03db18a2c481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-961d70b9-28c0-463e-94f5-03db18a2c481 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:44.337577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:44.338536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:44.339383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 413/845] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:44.340104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e690a-c3c3-4cd1-b523-9b3c9e0c298b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.340718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e690a-c3c3-4cd1-b523-9b3c9e0c298b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.340718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e690a-c3c3-4cd1-b523-9b3c9e0c298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.356529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db75410-797e-4d78-a692-b42b4bd2983b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.357778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a18e690a-c3c3-4cd1-b523-9b3c9e0c298b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:44.358989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a18e690a-c3c3-4cd1-b523-9b3c9e0c298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:44.381411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.395159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.396154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.396473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.396792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.406927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.408382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.408497 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:44.428131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:44.429244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:44.430398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:44.430398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:44.430398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:44.430398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:44.433280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 414/846] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:44.434016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 433/847] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:44.434522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e690a-c3c3-4cd1-b523-9b3c9e0c298b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.434864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.546936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e690a-c3c3-4cd1-b523-9b3c9e0c298b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.551806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff114-f41e-460a-a805-b1537cb4545d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.583766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.584465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.584753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.585032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.585773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:44.586085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.587411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.587536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.588071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.588359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.588679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.589397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:44.589710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.591051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.600982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 415/848] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:44.600982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.606677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 434/849] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:44.611119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.645644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.652261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.717907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879f01e-7292-4627-8e7e-6fc6b2f8a8e8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.721145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00787-ee4b-4937-a73f-ad569acb0c50 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.759801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.760039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.760634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.760743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.760923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.761023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.761202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.761299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.761860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.763263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.773938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.775409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:44.776122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:44.777104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:44.777952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 416/850] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:44.778748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:44.798204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:44.799260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:44.800167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:44.800167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:44.800167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:44.800167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:44.800167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 435/851] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:44.801315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.909193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.909458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039b7c-763f-486f-bcc7-fe2c9ef41274 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.923601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:44.925862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812482-66ef-48da-a8f0-13695ad5bdc6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:44.954154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.955068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.955506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.955870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.964132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.965942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.967187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:44.967997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:44.968280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:44.968901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:44.969429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:44.969739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:44.971187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:44.981602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 436/852] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:44.982487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:44.983380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:44.988023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:44.988516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:44.988636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 417/853] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:44.988636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.117853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8272-d06e-4196-9587-1d8b65296643 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.135831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a0973-6f88-4615-9808-f1d266da0748 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.164836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.165574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.165868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.166151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.166883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:45.167629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.168944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.181069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 418/854] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:45.181069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.193097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.193788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.194078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.194346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.195151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:45.195498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.196957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.214961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 437/855] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:45.220956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.229318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:45.239483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:45.312650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b02ba-6281-4797-9376-593b271ff055 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.355144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e5afe-746a-44bd-8050-c592e3fb8b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.356480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e5afe-746a-44bd-8050-c592e3fb8b99 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.357046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e5afe-746a-44bd-8050-c592e3fb8b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.357508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e5afe-746a-44bd-8050-c592e3fb8b99 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.358510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e5afe-746a-44bd-8050-c592e3fb8b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:45.359050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e5afe-746a-44bd-8050-c592e3fb8b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.360629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e5afe-746a-44bd-8050-c592e3fb8b99 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.377742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 419/856] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:45.378927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2002-0653-4066-9336-19b22c572c95 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.379113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2002-0653-4066-9336-19b22c572c95 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.379393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2002-0653-4066-9336-19b22c572c95 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.380937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 420/857] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:45.383251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2002-0653-4066-9336-19b22c572c95 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.384169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6af0c-b7e6-47aa-bdf4-143be098da57 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.423422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4feac-680e-4ed7-9378-28a4e3101a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.424225 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4feac-680e-4ed7-9378-28a4e3101a6e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.424553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4feac-680e-4ed7-9378-28a4e3101a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.425496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4feac-680e-4ed7-9378-28a4e3101a6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.432789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4feac-680e-4ed7-9378-28a4e3101a6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.434219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4feac-680e-4ed7-9378-28a4e3101a6e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-e2f4feac-680e-4ed7-9378-28a4e3101a6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:45.448734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:45.449776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:45.450859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 438/858] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:45.451525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c15ba-a2be-4f48-91cd-f56158215090 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.451525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c15ba-a2be-4f48-91cd-f56158215090 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.452204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c15ba-a2be-4f48-91cd-f56158215090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.468432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-917c15ba-a2be-4f48-91cd-f56158215090 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:45.469644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-917c15ba-a2be-4f48-91cd-f56158215090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:45.491440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:45.503429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2002-0653-4066-9336-19b22c572c95 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.532424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:45.538475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 439/859] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:45.542732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.543404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.543939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.544218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.544849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c15ba-a2be-4f48-91cd-f56158215090 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.545075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=45668b6b20b644689d57844dc6b77ef1) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:45.545388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.546842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.560719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 421/860] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/role_assignments?user.id=45668b6b20b644689d57844dc6b77ef1&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:45.562591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.697038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c15ba-a2be-4f48-91cd-f56158215090 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.705135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247d020-e93a-4108-94b8-30e121d4b4db None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.740473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.741550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.742056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.742540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.743572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:45.744821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.746860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.760142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.761018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.761307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.761588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.762254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.763648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.768888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 440/861] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:45.774190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:45.778411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:45.779508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:45.780377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 422/862] 10.222.0.59 () {56 vars in 1132 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:45.786588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:45.814891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:45.847939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:45.908245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103383d3-018f-46f6-bd7f-76769c8d2f3d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.912751 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0610-3646-45ba-acdf-212df3dac909 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:45.951012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.951807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.952309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.952740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.953502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:45.953885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:45.955040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:45.955872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:45.956096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:45.956478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:45.956932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:45.966896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 423/863] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:45.969111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:46.056310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:46.058507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:46.096484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:46.115101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42f795-768f-4901-9ec5-ded655a5b91a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:46.131803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:46.153269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:46.154375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:46.154858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:46.155343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:46.156348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:46.156899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:46.158580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:46.172821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 424/864] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:46.182644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 441/865] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:42:46.188123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:46.310047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ef699-ede1-4599-a654-d6b70bd1dd25 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:46.348911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:46.349775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:46.350060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:46.350338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:46.364537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:46.366626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:46.375906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:46.390062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:46.391217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:46.392193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:46.392193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:46.392193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:46.392193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:46.394698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 425/866] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:46.399992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:46.510671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72757ca-f12a-4a23-923b-b236b0688219 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:46.546194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:46.546863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:46.547150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:46.547427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:46.548152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:46.548463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:46.549861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:46.562506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 442/867] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:46.567902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:46.671238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58dec-5c52-48cc-bcbd-a7e2d1ae785f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:46.706209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:46.707263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:46.707696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:46.708122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:46.715474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:46.717177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:46.736333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:46.737491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:46.738613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:46.741796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 426/868] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:46.752613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:46.793069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:46.853545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502403-f1b6-4f56-9255-f3cc34bef3d8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:46.888653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47482-7f6e-42b3-8c1b-a8d742d3c539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:46.889325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47482-7f6e-42b3-8c1b-a8d742d3c539 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:46.889612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47482-7f6e-42b3-8c1b-a8d742d3c539 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:46.889891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47482-7f6e-42b3-8c1b-a8d742d3c539 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:46.890678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c47482-7f6e-42b3-8c1b-a8d742d3c539 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:46.890989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c47482-7f6e-42b3-8c1b-a8d742d3c539 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:46.892415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c47482-7f6e-42b3-8c1b-a8d742d3c539 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:46.905318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 443/869] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:46.911115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:46.973055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:47.016806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eaf1e-385d-491b-943c-7aebf5fcdf1f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:47.052265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609129e4-c45d-4525-a139-5ce303ab9ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:47.053403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609129e4-c45d-4525-a139-5ce303ab9ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:47.053689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609129e4-c45d-4525-a139-5ce303ab9ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:47.053969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609129e4-c45d-4525-a139-5ce303ab9ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:47.054812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609129e4-c45d-4525-a139-5ce303ab9ff7 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=f2c1ef0b6b3241a19397b8696c05fc99) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:47.055133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609129e4-c45d-4525-a139-5ce303ab9ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:47.056694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609129e4-c45d-4525-a139-5ce303ab9ff7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:47.063150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 427/870] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:46 2022] GET /identity/v3/role_assignments?user.id=f2c1ef0b6b3241a19397b8696c05fc99&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:47.516983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3ac3d-ac63-4129-9481-1919457d02b8 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:47.517378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3ac3d-ac63-4129-9481-1919457d02b8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:47.517573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3ac3d-ac63-4129-9481-1919457d02b8 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:47.519168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 444/871] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:47.525223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e7cc9-926a-42d7-8f3c-c9e0d251151b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:47.525517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e7cc9-926a-42d7-8f3c-c9e0d251151b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:47.525805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e7cc9-926a-42d7-8f3c-c9e0d251151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:47.542689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f11e7cc9-926a-42d7-8f3c-c9e0d251151b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:47.544130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f11e7cc9-926a-42d7-8f3c-c9e0d251151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:47.618284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 428/872] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:47.640977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3ac3d-ac63-4129-9481-1919457d02b8 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:47.723611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:47.751286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3ac3d-ac63-4129-9481-1919457d02b8 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:47.786655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab2e0-1918-456d-bba6-5d4c58af8a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:47.787309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab2e0-1918-456d-bba6-5d4c58af8a05 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:47.787545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab2e0-1918-456d-bba6-5d4c58af8a05 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:47.787885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab2e0-1918-456d-bba6-5d4c58af8a05 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:47.788657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aab2e0-1918-456d-bba6-5d4c58af8a05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:47.790090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aab2e0-1918-456d-bba6-5d4c58af8a05 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:47.814749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 445/873] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:42:47 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:48.001272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c977-dd67-41ca-83c6-382b8c2058b8 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.001907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c977-dd67-41ca-83c6-382b8c2058b8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.002428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7c977-dd67-41ca-83c6-382b8c2058b8 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.003946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 429/874] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:48.009784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a02826-dcf2-412d-8ba7-37b9a9251cf8 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.010080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a02826-dcf2-412d-8ba7-37b9a9251cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.010368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a02826-dcf2-412d-8ba7-37b9a9251cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.028084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b1a02826-dcf2-412d-8ba7-37b9a9251cf8 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:48.029383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b1a02826-dcf2-412d-8ba7-37b9a9251cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:48.116042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 446/875] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:48.139133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7c977-dd67-41ca-83c6-382b8c2058b8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:48.199430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:48.256651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7c977-dd67-41ca-83c6-382b8c2058b8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:48.295801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039108-c68f-458e-90b4-7649e719439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:48.297004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039108-c68f-458e-90b4-7649e719439c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.297496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039108-c68f-458e-90b4-7649e719439c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.297991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039108-c68f-458e-90b4-7649e719439c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.309581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11039108-c68f-458e-90b4-7649e719439c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-11039108-c68f-458e-90b4-7649e719439c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:48.318304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:48.319271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:42:48.320129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:48.322899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 430/876] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 18 14:42:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:48.331776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a02826-dcf2-412d-8ba7-37b9a9251cf8 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:48.403050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:48.451822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a02826-dcf2-412d-8ba7-37b9a9251cf8 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:48.487966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aac1b-fada-4572-ba62-1241d2afd1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:48.488670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aac1b-fada-4572-ba62-1241d2afd1dd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.488962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aac1b-fada-4572-ba62-1241d2afd1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.489243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aac1b-fada-4572-ba62-1241d2afd1dd None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.490033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aac1b-fada-4572-ba62-1241d2afd1dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:48.490350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aac1b-fada-4572-ba62-1241d2afd1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:48.491733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aac1b-fada-4572-ba62-1241d2afd1dd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:48.500814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 447/877] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 18 14:42:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:48.506042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039108-c68f-458e-90b4-7649e719439c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:48.585128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096bc9-2638-414c-a2aa-98b519afad30 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.585445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096bc9-2638-414c-a2aa-98b519afad30 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.585721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096bc9-2638-414c-a2aa-98b519afad30 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.588624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 448/878] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:48.592689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6fb19-5d89-4c69-b201-07bbafd43519 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.593087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6fb19-5d89-4c69-b201-07bbafd43519 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.593377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6fb19-5d89-4c69-b201-07bbafd43519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.612317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039108-c68f-458e-90b4-7649e719439c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:48.612631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e2b6fb19-5d89-4c69-b201-07bbafd43519 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:48.613955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e2b6fb19-5d89-4c69-b201-07bbafd43519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:48.627005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:48.650124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:48.651046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.651339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.651619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.667127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:48.669545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:48.691190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:48.692130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:48.693130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:48.693130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:48.693130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:48.693130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:48.693130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 431/880] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:48.696680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 449/880] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:48.701552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:48.713764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6fb19-5d89-4c69-b201-07bbafd43519 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:48.782926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:48.830336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6fb19-5d89-4c69-b201-07bbafd43519 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:48.836195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0d7e-ce06-4ec1-af9a-74f0854a7f89 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:48.864947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:48.865619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.865908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.866190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.866964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:48.868295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:48.879388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:48.880340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:48.881502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:48.882004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:48.882994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:48.883554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:48.885225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:48.888667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 450/881] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:42:48 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:42:48.905251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 432/882] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:48.911818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:49.039765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ee76-e4ab-4e7e-8391-58dad4914da4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:49.055640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:49.082027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:49.083251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:49.084315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:49.084853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:49.094299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:49.096147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:49.112794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:49.113849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:49.114885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:49.117610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 451/883] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:42:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:49.123369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:49.156098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:49.244629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe061-42de-4714-87ba-be5c94ca63fe None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:49.280973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c10fa2-d093-4810-a89b-85b8679c15e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:49.281922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c10fa2-d093-4810-a89b-85b8679c15e2 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:49.282441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c10fa2-d093-4810-a89b-85b8679c15e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:49.282859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c10fa2-d093-4810-a89b-85b8679c15e2 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:49.283905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c10fa2-d093-4810-a89b-85b8679c15e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:49.284390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c10fa2-d093-4810-a89b-85b8679c15e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:49.286062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c10fa2-d093-4810-a89b-85b8679c15e2 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:49.308787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 433/884] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 18 14:42:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:49.314992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:49.432911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c8965-87f7-4f51-8223-dd2d5f47f5a7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:49.473323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:49.473904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:49.474190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:49.475023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:49.496789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd98ea-18db-4146-bc19-cb25932ca9ab None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:49.497079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd98ea-18db-4146-bc19-cb25932ca9ab None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:49.497354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd98ea-18db-4146-bc19-cb25932ca9ab None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:49.498983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 434/885] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:49.504008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb404-0362-45a6-989d-7c6ce2cc8bdc None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:49.504300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb404-0362-45a6-989d-7c6ce2cc8bdc None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:49.504589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb404-0362-45a6-989d-7c6ce2cc8bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:49.523348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-27ccb404-0362-45a6-989d-7c6ce2cc8bdc None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:49.524548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-27ccb404-0362-45a6-989d-7c6ce2cc8bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:49.547339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:49.575106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:49.577024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:49.608340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 435/886] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:49.628813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccb404-0362-45a6-989d-7c6ce2cc8bdc None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:49.646226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:49.725390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 452/887] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:42:49.731443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:49.767282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccb404-0362-45a6-989d-7c6ce2cc8bdc None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:49.810141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:49.811347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:49.811979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:49.812611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:49.813445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:49.815808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:49.816028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:49.830377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:49.831672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:49.832742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:49.840764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 436/888] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:49.842263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:49.858600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ba8ff-23d5-4001-81e9-18dda039feec None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:49.902629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:49.904017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:49.904458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:49.904868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:49.915953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:49.917776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:49.941206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:49.944510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:49.945525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:49.946457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:49.946457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:49.946457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:49.946457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:49.950036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 453/889] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:49.954003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:49.977853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca56dc-f2d0-4f06-9787-3b1a3eab1652 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.027013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.028228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.029090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.029549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.030647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:50.031360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.033660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.040525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 437/890] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:42:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:50.047343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:50.083189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c68ac1-9f7c-4761-85e8-f615254cd314 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.108387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:50.122099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.122904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.123196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.123474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.124341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:50.124670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.126047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.142805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 454/891] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:50.143740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:50.182865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1d2f-2712-4578-aa70-21cc63d66b0a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.221986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862a869-f3bc-4b38-9bf6-39d91f74a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.222665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862a869-f3bc-4b38-9bf6-39d91f74a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.222964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862a869-f3bc-4b38-9bf6-39d91f74a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.223216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862a869-f3bc-4b38-9bf6-39d91f74a8d6 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.224904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862a869-f3bc-4b38-9bf6-39d91f74a8d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:50.224904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862a869-f3bc-4b38-9bf6-39d91f74a8d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.226188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862a869-f3bc-4b38-9bf6-39d91f74a8d6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.240635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 438/892] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:50.240635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8189-b855-42e2-a283-9a7248c3e5b0 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.240635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8189-b855-42e2-a283-9a7248c3e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.240635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec8189-b855-42e2-a283-9a7248c3e5b0 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.240635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 439/893] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:50.242266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7cf2-9a93-4be8-95f1-474cc19efcd0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.242549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7cf2-9a93-4be8-95f1-474cc19efcd0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.242823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7cf2-9a93-4be8-95f1-474cc19efcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.255277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:50.261366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-fc2a7cf2-9a93-4be8-95f1-474cc19efcd0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:50.262825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-fc2a7cf2-9a93-4be8-95f1-474cc19efcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:50.267676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4dbf-8b99-4213-b842-01a4297101c0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.315867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.316817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.317170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.317517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.326075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.327747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:50.344774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:50.345727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:50.346627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 455/894] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:50.353706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:50.354703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 440/895] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:50.378976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7cf2-9a93-4be8-95f1-474cc19efcd0 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:50.420961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:50.492246 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b1ae-8092-47fc-8ab4-a3cf3f21acc8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.510918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7cf2-9a93-4be8-95f1-474cc19efcd0 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.534664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.535460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.535841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.536242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.537209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:50.537617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.539866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.554490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.559843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.559843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.559843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.559843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.559843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.560436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 456/896] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:50.561594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:50.562510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:50.573953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:50.575125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:50.575971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:50.580795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 441/897] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:50.582061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:50.673769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee268e-924b-4727-8240-ca14b823069c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.676413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:50.684680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede81c5-81f8-46a1-8c21-06008a3c8946 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.713894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.715160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.715915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.716392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.717448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] RBAC: Adding query filter params (role.id=5abc12b86c294392abccf8fa7ac5a038, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=45668b6b20b644689d57844dc6b77ef1) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:50.717949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.719563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.720312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.721094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.721446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.721793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.722623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:50.723001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.724483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.732947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 457/899] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/role_assignments?user.id=45668b6b20b644689d57844dc6b77ef1&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=5abc12b86c294392abccf8fa7ac5a038 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:50.733130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 442/899] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:50.735615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:50.821809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:50.859286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15b630-595f-4011-84b6-43f0d1dd79c4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:50.898356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:50.899358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:50.899831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:50.900323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:50.901260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:50.901778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:50.903383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:50.909832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 443/900] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:50.917736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:51.033524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11df1a-93cd-4cfb-a64a-59bed9857193 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:51.070319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c9022-3401-4097-b29c-40c62a1b52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:51.071227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c9022-3401-4097-b29c-40c62a1b52ab None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:51.071663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c9022-3401-4097-b29c-40c62a1b52ab None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:51.072114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c9022-3401-4097-b29c-40c62a1b52ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:51.073086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c9022-3401-4097-b29c-40c62a1b52ab None admin] RBAC: Adding query filter params (interface=public, service_id=80ac0fa4fead478aade9e8aec6dbfbf7, region_id=RegionOne) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:51.073550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c9022-3401-4097-b29c-40c62a1b52ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:51.075214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c9022-3401-4097-b29c-40c62a1b52ab None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:51.081147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 458/901] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:42:50 2022] GET /identity/v3/endpoints?service_id=80ac0fa4fead478aade9e8aec6dbfbf7&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:51.089693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:51.214837 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e2c8f-1533-4172-8ca0-8c9797b9f123 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:51.246203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:51.254349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22aa5fa-9735-4d07-8caa-e353ef602928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:51.255020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa5fa-9735-4d07-8caa-e353ef602928 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:51.255302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa5fa-9735-4d07-8caa-e353ef602928 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:51.255690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa5fa-9735-4d07-8caa-e353ef602928 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:51.256454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22aa5fa-9735-4d07-8caa-e353ef602928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:51.258347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22aa5fa-9735-4d07-8caa-e353ef602928 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:51.268735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 444/902] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:42:51 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:42:51.323359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028ed7-d03d-4fe2-a3e0-32a51955c6ae None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:51.323607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028ed7-d03d-4fe2-a3e0-32a51955c6ae None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:51.323849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028ed7-d03d-4fe2-a3e0-32a51955c6ae None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:51.325642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 459/903] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:51.331467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251363e-7d6e-4aed-9bf0-3c3fc11c47e9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:51.331773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251363e-7d6e-4aed-9bf0-3c3fc11c47e9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:51.332022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251363e-7d6e-4aed-9bf0-3c3fc11c47e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:51.350636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-4251363e-7d6e-4aed-9bf0-3c3fc11c47e9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:51.351849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4251363e-7d6e-4aed-9bf0-3c3fc11c47e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:51.426134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 445/904] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:51.452341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028ed7-d03d-4fe2-a3e0-32a51955c6ae None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:51.486005 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:51.561325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028ed7-d03d-4fe2-a3e0-32a51955c6ae None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:51.597030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:51.597771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:51.598057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:51.598337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:51.599000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:51.601083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:51.614142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:51.615119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:51.616183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 460/905] 10.222.0.59 () {56 vars in 1132 bytes} [Wed May 18 14:42:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:51.621363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251363e-7d6e-4aed-9bf0-3c3fc11c47e9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:51.722085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251363e-7d6e-4aed-9bf0-3c3fc11c47e9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:51.745351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:51.757459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:51.758133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:51.758418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:51.758696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:51.759405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:51.759718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:51.761144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:51.766057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 446/906] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:51.772209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:51.867010 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:51.873240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b347-cb64-49cd-90f2-f24045deb340 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:51.908092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:51.908788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:51.909075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:51.909356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:51.910068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:51.910377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:51.911776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:51.917016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 461/907] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:51.922707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:52.035400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762a43a-56cd-4a80-8c71-e7eb0c10d560 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:52.073495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47406bf-e23b-4f39-b259-a74316ebd4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:52.074175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47406bf-e23b-4f39-b259-a74316ebd4ad None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:52.074463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47406bf-e23b-4f39-b259-a74316ebd4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:52.074745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47406bf-e23b-4f39-b259-a74316ebd4ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:52.075548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47406bf-e23b-4f39-b259-a74316ebd4ad None admin] RBAC: Adding query filter params (interface=public, service_id=2e7d343994e54227a59b63d92578dc10, region_id=RegionOne) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:52.075866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47406bf-e23b-4f39-b259-a74316ebd4ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:52.077501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47406bf-e23b-4f39-b259-a74316ebd4ad None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:52.083079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 447/908] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:42:51 2022] GET /identity/v3/endpoints?service_id=2e7d343994e54227a59b63d92578dc10&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:52.089426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:52.204373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b3d04-6e21-41ff-bdad-f278fdd5927c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:52.239606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d21e82-8da3-4b1d-884e-bc824b29a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:52.240363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d21e82-8da3-4b1d-884e-bc824b29a349 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:52.240678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d21e82-8da3-4b1d-884e-bc824b29a349 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:52.240965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d21e82-8da3-4b1d-884e-bc824b29a349 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:52.241644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d21e82-8da3-4b1d-884e-bc824b29a349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:52.243121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d21e82-8da3-4b1d-884e-bc824b29a349 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:52.250743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 462/909] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:42:52 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:42:52.597289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cb6a-42c6-4a9e-b8ef-b11accd5b9cd None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:52.597969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cb6a-42c6-4a9e-b8ef-b11accd5b9cd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:52.598463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cb6a-42c6-4a9e-b8ef-b11accd5b9cd None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:52.600324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 448/910] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:52.605913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cef83-3233-4f59-b4d7-16a3360d3737 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:52.606453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cef83-3233-4f59-b4d7-16a3360d3737 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:52.606967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cef83-3233-4f59-b4d7-16a3360d3737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:52.624256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f31cef83-3233-4f59-b4d7-16a3360d3737 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:52.625776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f31cef83-3233-4f59-b4d7-16a3360d3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:52.644380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:52.700992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 463/911] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:52.720205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143cb6a-42c6-4a9e-b8ef-b11accd5b9cd None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:52.776983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:52.824952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143cb6a-42c6-4a9e-b8ef-b11accd5b9cd None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:52.864200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde78b47-618d-4213-badd-959803a0a4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:52.864863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde78b47-618d-4213-badd-959803a0a4e5 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:52.865153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde78b47-618d-4213-badd-959803a0a4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:52.865433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde78b47-618d-4213-badd-959803a0a4e5 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:52.866178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde78b47-618d-4213-badd-959803a0a4e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:52.867629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde78b47-618d-4213-badd-959803a0a4e5 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:52.884472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 449/912] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:42:52 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:53.281400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e1552-6ef5-4c4e-9045-41ac1983a191 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.281916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e1552-6ef5-4c4e-9045-41ac1983a191 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.282203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e1552-6ef5-4c4e-9045-41ac1983a191 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.283947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 464/913] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:53.290122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6442-94f5-4fb6-8f27-7f3f59b93bde None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.290535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6442-94f5-4fb6-8f27-7f3f59b93bde None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.290916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6442-94f5-4fb6-8f27-7f3f59b93bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.309503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c00e6442-94f5-4fb6-8f27-7f3f59b93bde None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:53.310706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c00e6442-94f5-4fb6-8f27-7f3f59b93bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:53.387592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 450/914] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:53.410838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e1552-6ef5-4c4e-9045-41ac1983a191 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:53.520657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e1552-6ef5-4c4e-9045-41ac1983a191 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:53.557372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb728fb9-c6d7-4d6a-bfe8-7690b32f97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:53.558190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728fb9-c6d7-4d6a-bfe8-7690b32f97f0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.558470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728fb9-c6d7-4d6a-bfe8-7690b32f97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.558745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728fb9-c6d7-4d6a-bfe8-7690b32f97f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.569194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb728fb9-c6d7-4d6a-bfe8-7690b32f97f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-cb728fb9-c6d7-4d6a-bfe8-7690b32f97f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:53.577535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:53.578508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:53.579354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 465/915] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 18 14:42:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:53.584843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6442-94f5-4fb6-8f27-7f3f59b93bde None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:53.585865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9d87a-6ce6-48b1-978f-5a4bc74fa63e None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.586360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9d87a-6ce6-48b1-978f-5a4bc74fa63e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.586841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9d87a-6ce6-48b1-978f-5a4bc74fa63e None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.588747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 466/916] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:53.593961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612498b-33af-43ef-8d05-3abfd32f91d5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.594496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612498b-33af-43ef-8d05-3abfd32f91d5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.594980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612498b-33af-43ef-8d05-3abfd32f91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.616444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4612498b-33af-43ef-8d05-3abfd32f91d5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:53.618639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4612498b-33af-43ef-8d05-3abfd32f91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:53.626926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:53.639794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:53.712604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 467/917] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:53.715952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6442-94f5-4fb6-8f27-7f3f59b93bde None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:53.731360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612498b-33af-43ef-8d05-3abfd32f91d5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:53.756673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:53.757841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.758342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.758816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.759758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:53.760371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:53.762169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:53.772341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 451/918] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 18 14:42:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:53.777471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:53.848029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612498b-33af-43ef-8d05-3abfd32f91d5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:53.883222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:53.885482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:53.888942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.888942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.888942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.888942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:53.889321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae03bd-3b91-4eaa-b081-3737fd8a3354 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:53.889407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:53.903656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:53.904930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 14:42:53.905860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:53.910998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 468/919] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:53.912861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:53.924916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:53.930806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:53.932779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:53.933244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:53.933715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:53.945977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:53.947834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:53.967600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:53.968597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:53.969504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:53.969504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:53.969504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:53.969504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:53.971844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 452/920] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:53.977484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.023445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5387f-4487-42c1-b018-46425cc18818 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.062671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.063441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.063794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.064659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.065060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:54.065441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.066897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.078681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 469/921] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:54.080267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.097843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a51c0-7fc9-4889-b3c2-946c47f50f54 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.135844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.137005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.137588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.138069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.138990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:54.139499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.141448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.155760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:54.157249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 453/922] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:54.164817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.180830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:54.192015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f5fc-3c7c-4f98-bd02-52d28d06fefb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.229060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.229843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.230244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.230617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.231425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:54.231832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.233477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.243219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 470/923] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:54.244599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.295425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e025185-fcb8-46bb-97f6-3fb1a49cdd97 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.336174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.337446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.337909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.338390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.347972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.349930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.351483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14322582-1fb7-4d5f-858c-912df2bac133 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:54.368470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:54.369540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:54.370487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:54.377224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 454/924] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:54.378382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.388511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629aee-44ce-41bb-8289-e83da83935c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.389355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629aee-44ce-41bb-8289-e83da83935c0 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.389737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629aee-44ce-41bb-8289-e83da83935c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.390111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629aee-44ce-41bb-8289-e83da83935c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.390941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629aee-44ce-41bb-8289-e83da83935c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.392397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629aee-44ce-41bb-8289-e83da83935c0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.397284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:54.421333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 471/925] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:42:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:42:54.462987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:54.498144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986e77f-9a53-489d-af34-f90f521594f4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.525084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6d71-1c8a-4e3b-be15-479b38c37a24 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.525481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6d71-1c8a-4e3b-be15-479b38c37a24 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.525646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6d71-1c8a-4e3b-be15-479b38c37a24 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.527326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 472/926] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:54.532968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d968b8-153d-4a15-958e-c9ad26ec8a1e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.533264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d968b8-153d-4a15-958e-c9ad26ec8a1e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.533540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d968b8-153d-4a15-958e-c9ad26ec8a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.544116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.544841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.545128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.545411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.546315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:54.546574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.548058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.553186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-19d968b8-153d-4a15-958e-c9ad26ec8a1e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:54.554682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-19d968b8-153d-4a15-958e-c9ad26ec8a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:54.572258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 455/927] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:54.577786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.632942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 473/928] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:54.656823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d968b8-153d-4a15-958e-c9ad26ec8a1e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.692408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6866e-7519-4f3e-abc2-bf77f9280ce0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.722089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:54.733606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.734409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.734691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.734967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.746289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.747759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:54.766111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:54.767071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:54.767980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:54.767980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:54.767980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:54.767980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:54.771971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 456/929] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:54.773186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.776670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d968b8-153d-4a15-958e-c9ad26ec8a1e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.803881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:54.819642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.819971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.820217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.820496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.821194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.822562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:54.835866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:54.836915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:54.837756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 474/930] 10.222.0.59 () {56 vars in 1132 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:54.842979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.913187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5d0c-5297-43ac-ad49-436e3230213c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.954931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33699-bc80-4d05-b216-3266e9f31401 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:54.961286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.962236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.962706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:54.963589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:54.964503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:54.965021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:54.967288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:54.982087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 457/931] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:54.990439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:54.999025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:54.999712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:54.999998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.000278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.001046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:55.001355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.003491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.011148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 475/932] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:55.017570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:55.036074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:55.076211 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:55.107190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c561a-2afd-4717-bf3d-f2037561b7f4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:55.141573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dc384-8c82-4c99-9f97-c882c71351cb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:55.155434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:55.156980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.157704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.158133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.167865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.170660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.177734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f261-975c-4bc0-a02d-b149bdadd3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:55.178415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f261-975c-4bc0-a02d-b149bdadd3ea None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.178695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f261-975c-4bc0-a02d-b149bdadd3ea None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.178970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f261-975c-4bc0-a02d-b149bdadd3ea None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.179666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f261-975c-4bc0-a02d-b149bdadd3ea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:55.179973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f261-975c-4bc0-a02d-b149bdadd3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.181368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f261-975c-4bc0-a02d-b149bdadd3ea None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.190853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 476/933] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:55.191620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:55.192534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:55.194074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 458/934] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:55.195006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f94ff6-8d9e-4097-9d74-94726877bca2 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.195245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f94ff6-8d9e-4097-9d74-94726877bca2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.199849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f94ff6-8d9e-4097-9d74-94726877bca2 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.199849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 477/935] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:55.200067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:55.200724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f94ff6-8d9e-4097-9d74-94726877bca2 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:55.319609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:55.322382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f94ff6-8d9e-4097-9d74-94726877bca2 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:55.326694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf106597-8856-4653-84a4-dd5ccd93e963 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:55.338796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:55.362687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb519d1-bf8e-4780-982d-198519d41eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:55.363490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb519d1-bf8e-4780-982d-198519d41eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.363664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb519d1-bf8e-4780-982d-198519d41eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.363903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb519d1-bf8e-4780-982d-198519d41eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.364762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb519d1-bf8e-4780-982d-198519d41eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:55.365080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb519d1-bf8e-4780-982d-198519d41eb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.366520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb519d1-bf8e-4780-982d-198519d41eb9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.366953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:55.367610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.368027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.368149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.368921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.370293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.379384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 478/936] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:55.380552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82332-9b33-4166-8406-abef744eab6a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.380913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82332-9b33-4166-8406-abef744eab6a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.381198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82332-9b33-4166-8406-abef744eab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.397183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 459/937] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:42:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:55.397859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:55.404693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1fd82332-9b33-4166-8406-abef744eab6a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:55.406942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1fd82332-9b33-4166-8406-abef744eab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:55.497600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 479/938] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:55.520706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd82332-9b33-4166-8406-abef744eab6a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:55.548411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784973f-5fea-418f-921c-371debf9e86a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:55.604456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:55.607529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.608735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.609511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/45668b6b20b644689d57844dc6b77ef1/roles/5abc12b86c294392abccf8fa7ac5a038` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.616454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=45668b6b20b644689d57844dc6b77ef1, role_id=5abc12b86c294392abccf8fa7ac5a038)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.618554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.634687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:55.638542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd82332-9b33-4166-8406-abef744eab6a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:55.639343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 460/939] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:42:55 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/45668b6b20b644689d57844dc6b77ef1/roles/5abc12b86c294392abccf8fa7ac5a038 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:42:55.685196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:55.686125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.686416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.686696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.687363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.688842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:55.702471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:55.703542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:55.704593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 480/940] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:55.711017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:55.730163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:55.830257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cf070-f189-408c-8e7a-6275a704a104 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:55.866963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:55.867573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:55.867853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:55.868133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:55.868886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:55.869196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:55.870614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:55.876178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 461/941] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:42:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:55.882330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:55.987405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ec8de-354a-48c1-a0b0-79bcf8d4cbcd None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:56.024085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:56.024786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:56.025078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:56.025364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:56.026075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:56.026391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:56.027769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:56.032970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 481/942] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:42:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:56.038829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:56.120049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:56.144123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bc474-b638-451b-8b7e-b12af161e208 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:56.179951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08919564-c514-44ea-b321-dc78ae0953cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:56.180660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08919564-c514-44ea-b321-dc78ae0953cf None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:56.180959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08919564-c514-44ea-b321-dc78ae0953cf None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:56.181242 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08919564-c514-44ea-b321-dc78ae0953cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:56.182038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08919564-c514-44ea-b321-dc78ae0953cf None admin] RBAC: Adding query filter params (interface=public, service_id=eeb70e1e81764bc1a79bf46e5893bae7, region_id=RegionOne) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:56.182358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08919564-c514-44ea-b321-dc78ae0953cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:56.183754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08919564-c514-44ea-b321-dc78ae0953cf None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:56.189591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 462/943] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:42:56 2022] GET /identity/v3/endpoints?service_id=eeb70e1e81764bc1a79bf46e5893bae7&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:56.195203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:56.231525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:56.305536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768e9db-9575-42d9-bbb8-07492daf57f4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:56.344854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b105-5430-4df9-9533-bdc5b293bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:56.345538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b105-5430-4df9-9533-bdc5b293bb0e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:56.345823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b105-5430-4df9-9533-bdc5b293bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:56.346105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b105-5430-4df9-9533-bdc5b293bb0e None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:56.346790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b105-5430-4df9-9533-bdc5b293bb0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:56.348161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b105-5430-4df9-9533-bdc5b293bb0e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:56.354776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 482/944] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:42:56 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:42:56.865479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ae1b-b430-455c-bb0b-b62bc61f0f20 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:56.865857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ae1b-b430-455c-bb0b-b62bc61f0f20 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:56.866065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3ae1b-b430-455c-bb0b-b62bc61f0f20 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:56.867680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 463/945] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:56.873026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209743bc-b2b1-4da7-ae45-c7acaaa83ceb None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:56.873464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209743bc-b2b1-4da7-ae45-c7acaaa83ceb None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:56.873638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209743bc-b2b1-4da7-ae45-c7acaaa83ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:56.890467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-209743bc-b2b1-4da7-ae45-c7acaaa83ceb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:56.891661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-209743bc-b2b1-4da7-ae45-c7acaaa83ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:56.965748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 483/946] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:56.988979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ae1b-b430-455c-bb0b-b62bc61f0f20 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:57.094940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3ae1b-b430-455c-bb0b-b62bc61f0f20 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:57.129149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:57.129745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:57.130034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:57.130833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:57.131784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:57.133271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:57.134646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING keystone.server.flask.common [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 18 14:42:57.145537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:57.155887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.sql.core [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 14:42:57.155887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 14:42:57.155887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [parameters: {'id': '007cf3c098f34f96b3214a1805b092d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 14:42:57.155887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86728) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 007cf3c098f34f96b3214a1805b092d6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 007cf3c098f34f96b3214a1805b092d6. May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application result = self._query(query) May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application conn.query(q) May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 14:42:57.176034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application result.read() May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 18 14:42:57.176941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return project_ref.to_dict() May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application next(self.gen) May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application yield resource May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application next(self.gen) May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self.session.rollback() May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self.force_reraise() May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise self.value May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application session.commit() May 18 14:42:57.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._prepare_impl() May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self.session.flush() May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._flush(objects) May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application compat.raise_( May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application flush_context.execute() May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 14:42:57.180167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rec.execute(self) May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 14:42:57.185656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application result = self._query(query) May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application conn.query(q) May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application result.read() May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 14:42:57.187198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [parameters: {'id': '007cf3c098f34f96b3214a1805b092d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:57.189075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:57.190969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.Conflict( May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 007cf3c098f34f96b3214a1805b092d6. May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:57.193482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 464/947] 10.222.0.59 () {60 vars in 1140 bytes} [Wed May 18 14:42:56 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:57.194048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209743bc-b2b1-4da7-ae45-c7acaaa83ceb None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:57.216989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:57.297670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209743bc-b2b1-4da7-ae45-c7acaaa83ceb None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:57.333403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4f044-b1b2-4603-99ea-e4326fc27ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:57.335073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4f044-b1b2-4603-99ea-e4326fc27ed2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:57.335558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4f044-b1b2-4603-99ea-e4326fc27ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:57.336014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4f044-b1b2-4603-99ea-e4326fc27ed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:57.343376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4f044-b1b2-4603-99ea-e4326fc27ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:57.345057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4f044-b1b2-4603-99ea-e4326fc27ed2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-44c4f044-b1b2-4603-99ea-e4326fc27ed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:42:57.359988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:57.360976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:42:57.361908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:57.364055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 484/948] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:57.370183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:57.481480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d890a-94a7-4058-b2d2-07db8c0a9672 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:57.518957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88243951-75b6-474e-871a-f9a2b34485fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:57.519939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88243951-75b6-474e-871a-f9a2b34485fe None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:57.520378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88243951-75b6-474e-871a-f9a2b34485fe None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:57.520840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88243951-75b6-474e-871a-f9a2b34485fe None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:57.522274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88243951-75b6-474e-871a-f9a2b34485fe None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:57.523094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88243951-75b6-474e-871a-f9a2b34485fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:57.525379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88243951-75b6-474e-871a-f9a2b34485fe None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:57.547909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 465/949] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:57.824183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2729-0953-459b-b087-1f118d2d0933 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:57.824495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2729-0953-459b-b087-1f118d2d0933 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:57.824754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2729-0953-459b-b087-1f118d2d0933 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:57.826413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 485/950] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:57.832621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aedd3-9113-439b-8c56-1bc2c0bec4f2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:57.832934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aedd3-9113-439b-8c56-1bc2c0bec4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:57.833210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aedd3-9113-439b-8c56-1bc2c0bec4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:57.852744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-212aedd3-9113-439b-8c56-1bc2c0bec4f2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:57.854304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-212aedd3-9113-439b-8c56-1bc2c0bec4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:57.909984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:57.931402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 466/951] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:42:57.953752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e2729-0953-459b-b087-1f118d2d0933 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.034246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238df7a-eb39-417b-94ae-a3427bbbdb87 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.039520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238df7a-eb39-417b-94ae-a3427bbbdb87 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.040036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238df7a-eb39-417b-94ae-a3427bbbdb87 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.042057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 467/952] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:42:58.049564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f04fc-d5b2-4f63-87d7-89ef69f11d8b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.050100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f04fc-d5b2-4f63-87d7-89ef69f11d8b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.050599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f04fc-d5b2-4f63-87d7-89ef69f11d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.056031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:58.077686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e52f04fc-d5b2-4f63-87d7-89ef69f11d8b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:58.079039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e52f04fc-d5b2-4f63-87d7-89ef69f11d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:58.080285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e2729-0953-459b-b087-1f118d2d0933 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.119378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.120572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.121032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.121459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.122274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:58.123646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:58.136077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:58.137264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:58.138170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 486/953] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:42:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:58.144886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.175028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 468/954] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:58.200314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f04fc-d5b2-4f63-87d7-89ef69f11d8b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.270548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7b449-d8bf-45b8-9dee-960fa694b383 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.308054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f04fc-d5b2-4f63-87d7-89ef69f11d8b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.309513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.310387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.310775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.311152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.311979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] RBAC: Adding query filter params (name=compute) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:58.312389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:58.314043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:58.324422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 487/955] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:58.325394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:58.326363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.341044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:58.347118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.347948 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.348236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.348861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.361467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:42:58.370697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:58.372677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:58.374464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 469/956] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:58.384607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.447396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45edd-d349-4828-bfa1-c09ffa24644b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.486801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.487587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.487909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.488202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.489082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:58.489397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:58.490963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:58.496522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 488/957] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:58.498722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fe732-9397-4fdd-a4bd-81bd034c17a3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.539476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df0b8c-3882-4e70-b648-99f885b4da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.540172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0b8c-3882-4e70-b648-99f885b4da4b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.540453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0b8c-3882-4e70-b648-99f885b4da4b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.540769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0b8c-3882-4e70-b648-99f885b4da4b None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.541537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df0b8c-3882-4e70-b648-99f885b4da4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:58.541847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df0b8c-3882-4e70-b648-99f885b4da4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:58.543269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df0b8c-3882-4e70-b648-99f885b4da4b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:58.558039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 470/958] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:58.559480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.644307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:58.673323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e6b05-720a-4d1f-a222-603acf181c74 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.676290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522f61-3ce6-4ee2-90db-fa2a6fe53cb9 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.676836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522f61-3ce6-4ee2-90db-fa2a6fe53cb9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.677388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522f61-3ce6-4ee2-90db-fa2a6fe53cb9 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.679446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 471/959] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:42:58.686399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cfaa-dde1-4aee-9553-6975a2d977ab None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.686991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cfaa-dde1-4aee-9553-6975a2d977ab None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.687517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cfaa-dde1-4aee-9553-6975a2d977ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.706736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-eb77cfaa-dde1-4aee-9553-6975a2d977ab None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:42:58.708336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-eb77cfaa-dde1-4aee-9553-6975a2d977ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:42:58.718282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.718742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.719031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.719311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.731563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:58.733058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:58.752970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:58.753963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:58.754878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:58.754878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:58.754878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:58.754878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:58.754878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 489/960] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:58.760747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:58.763154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.793544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 472/961] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:42:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:42:58.816009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cfaa-dde1-4aee-9553-6975a2d977ab None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.871028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75150fd0-e0be-4c63-8919-e07f9f420a26 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.902055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:58.913360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.914051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.914382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.914671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.915911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:58.916243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:58.918082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:58.941647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 490/962] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:58.943695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:58.948996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cfaa-dde1-4aee-9553-6975a2d977ab None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:58.990852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:58.991743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:58.992030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:58.992314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:58.993064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:58.994707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:59.009222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:59.010314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:42:59.011160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 473/963] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:59.016790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:59.057797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:59.077477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522a49-4559-4f48-a281-b8a5946afb83 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:59.116064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:59.117374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:59.117867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:59.118324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:59.126100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:59.127794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.135862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55c74f-b924-43fb-b878-b55bacb1c3a9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:42:59.144065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:59.145043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 14:42:59.146061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:59.152776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 491/964] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:42:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:42:59.153767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:59.171603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:59.172270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:59.172552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:59.172855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:59.173665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:59.173977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:59.175472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.181498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 474/965] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:42:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:59.186841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:59.216349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:59.291142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4b613-d066-4b82-bdce-8b8e78de964f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:59.301689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:59.309344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba50be5-2f9a-4cc2-961d-5ad2b35962de None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:59.341975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:59.342652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:59.342924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:59.343201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:59.344047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:59.344359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:59.345839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.351149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:59.352100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:59.352649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:59.353401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:59.354371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:42:59.355074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:59.357655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.364605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 475/967] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:42:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:42:59.368750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 492/967] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 18 14:42:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:42:59.370542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:59.371736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:59.486643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d69b2-8024-4de8-940e-9d728d28d220 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:59.488641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fb89-bb2c-4e1b-b9cd-800060dc955a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:59.489084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:59.525491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:59.526153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:59.526438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:59.526715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:59.527446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:59.529128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.531816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:59.532857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:59.533431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:59.533901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:59.556614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 493/968] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:42:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:42:59.573138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:42:59.621109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:59.622921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.742970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 476/969] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:42:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 14:42:59.749763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:42:59.868565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98332e2-a260-4257-a485-22c9919011a4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:42:59.904063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569d77-7bd3-4fb1-ae30-4f99c2a8e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:42:59.905216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569d77-7bd3-4fb1-ae30-4f99c2a8e0ec None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:42:59.905679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569d77-7bd3-4fb1-ae30-4f99c2a8e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:42:59.906148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569d77-7bd3-4fb1-ae30-4f99c2a8e0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:42:59.917945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9569d77-7bd3-4fb1-ae30-4f99c2a8e0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:42:59.919949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9569d77-7bd3-4fb1-ae30-4f99c2a8e0ec None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-c9569d77-7bd3-4fb1-ae30-4f99c2a8e0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:42:59.937273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:42:59.938175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:42:59.939077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:42:59.939077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:42:59.939077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:42:59.939077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:42:59.941025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 494/970] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:42:59.948614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:00.006722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:00.042383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16efd6-d888-485b-ab70-7230c39eb48f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.042693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16efd6-d888-485b-ab70-7230c39eb48f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.042940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16efd6-d888-485b-ab70-7230c39eb48f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.044865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 495/971] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:00.051020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea28c-774c-48ac-9753-647612becb1e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.051308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea28c-774c-48ac-9753-647612becb1e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.051589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea28c-774c-48ac-9753-647612becb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.056445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa802-96b8-457d-917e-82517ac8aa00 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:00.069574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-662ea28c-774c-48ac-9753-647612becb1e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:00.071009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-662ea28c-774c-48ac-9753-647612becb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:00.073104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:00.101489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:00.102168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.102454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.102733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.103467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:00.103779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:00.105208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:00.118639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 477/972] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:00.126490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:00.160736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 496/973] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:43:00.182955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea28c-774c-48ac-9753-647612becb1e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:00.243723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a69a6-e1b5-4503-a545-2237d31c884e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:00.265350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:00.282032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:00.283190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.283672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.284143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.291431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:00.293161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:00.295479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea28c-774c-48ac-9753-647612becb1e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:43:00.309206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:00.310158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:00.311060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:00.318589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 478/974] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:00.319748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:00.336382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:00.337095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.337768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.338063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.338777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:00.340693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:00.342329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING keystone.server.flask.common [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 18 14:43:00.354344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:00.359787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.sql.core [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 14:43:00.359787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 14:43:00.359787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [parameters: {'user_id': '7fe1c1da22ec43eeba2ce6265879db46', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 14:43:00.359787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86727) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result = self._query(query) May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application conn.query(q) May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result.read() May 18 14:43:00.369502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 14:43:00.370873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application next(self.gen) May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application yield resource May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application next(self.gen) May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.session.rollback() May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.force_reraise() May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise self.value May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application session.commit() May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 14:43:00.371884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._prepare_impl() May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.session.flush() May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._flush(objects) May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application compat.raise_( May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application flush_context.execute() May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rec.execute(self) May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 14:43:00.372830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result = connection._execute_20( May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 14:43:00.373724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result = self._query(query) May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application conn.query(q) May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application result.read() May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 14:43:00.374579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [parameters: {'user_id': '7fe1c1da22ec43eeba2ce6265879db46', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:00.382551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 18 14:43:00.384497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 497/975] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 18 14:43:00 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:00.386661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:00.456737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f502c-d286-45fe-a3b7-148a4faad2dc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:00.498061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893ff47-a5ef-4a6e-8523-ac61f6f2001f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:00.501995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:00.502678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.502965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.503246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.504041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:00.504354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:00.506553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:00.526632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 479/976] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:00.528564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:00.543193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:00.544706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.544997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.545279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.556062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:00.558042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:00.577798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:43:00.578026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:00.578959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:00.579924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 498/977] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:43:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:00.586797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:00.650380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:00.654366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86154-ecc2-422d-bd6a-4796b46a3c5a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:00.694398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd63b5-c674-4279-bae8-30ee4c4977d5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:00.695196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a749d6-0aa8-4f2e-8716-57b0e378e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:00.696212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a749d6-0aa8-4f2e-8716-57b0e378e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.696812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a749d6-0aa8-4f2e-8716-57b0e378e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.697374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a749d6-0aa8-4f2e-8716-57b0e378e6e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.698390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a749d6-0aa8-4f2e-8716-57b0e378e6e9 None admin] RBAC: Adding query filter params (role.id=5abc12b86c294392abccf8fa7ac5a038, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=45668b6b20b644689d57844dc6b77ef1) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:00.698927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a749d6-0aa8-4f2e-8716-57b0e378e6e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:00.700561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a749d6-0aa8-4f2e-8716-57b0e378e6e9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:00.714336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 480/978] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:00 2022] GET /identity/v3/role_assignments?user.id=45668b6b20b644689d57844dc6b77ef1&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=5abc12b86c294392abccf8fa7ac5a038 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:00.731637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa53615-d747-4c2f-8684-8b04786ed832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:00.732334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa53615-d747-4c2f-8684-8b04786ed832 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.732707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa53615-d747-4c2f-8684-8b04786ed832 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.732996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa53615-d747-4c2f-8684-8b04786ed832 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.733812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa53615-d747-4c2f-8684-8b04786ed832 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:00.734127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa53615-d747-4c2f-8684-8b04786ed832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:00.735600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa53615-d747-4c2f-8684-8b04786ed832 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:00.779327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 499/979] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 18 14:43:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:00.832621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee1403-c14d-4575-aaf3-9a496b0316ed None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.832935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee1403-c14d-4575-aaf3-9a496b0316ed None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.833225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee1403-c14d-4575-aaf3-9a496b0316ed None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.835008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 481/980] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:00.841234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd8bc-e0be-4cbe-8be0-11868c1275c6 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:00.841524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd8bc-e0be-4cbe-8be0-11868c1275c6 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:00.841817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd8bc-e0be-4cbe-8be0-11868c1275c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:00.861716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f4bbd8bc-e0be-4cbe-8be0-11868c1275c6 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:00.863331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f4bbd8bc-e0be-4cbe-8be0-11868c1275c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:00.946722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 500/981] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:00.970268 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee1403-c14d-4575-aaf3-9a496b0316ed None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:01.082767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee1403-c14d-4575-aaf3-9a496b0316ed None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:01.086705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:01.121018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfcff2-87f3-4359-888d-bf328e78001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:01.121695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcff2-87f3-4359-888d-bf328e78001a None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:01.121976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcff2-87f3-4359-888d-bf328e78001a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:01.122253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcff2-87f3-4359-888d-bf328e78001a None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:01.122976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfcff2-87f3-4359-888d-bf328e78001a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:01.124365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfcff2-87f3-4359-888d-bf328e78001a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:01.142152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 482/982] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:43:00 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:43:01.948813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce7b5-c273-4e6b-8057-4eaf92824959 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:01.949356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce7b5-c273-4e6b-8057-4eaf92824959 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:01.949436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce7b5-c273-4e6b-8057-4eaf92824959 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:01.950861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 501/983] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:01.956498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f34d15-bbdd-407f-8ef8-3e06612c81a2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:01.956938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f34d15-bbdd-407f-8ef8-3e06612c81a2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:01.957102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f34d15-bbdd-407f-8ef8-3e06612c81a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:01.974781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-27f34d15-bbdd-407f-8ef8-3e06612c81a2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:01.975974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-27f34d15-bbdd-407f-8ef8-3e06612c81a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:02.051010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 483/984] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:02.073527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce7b5-c273-4e6b-8057-4eaf92824959 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:02.125406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:02.188504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce7b5-c273-4e6b-8057-4eaf92824959 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:02.228812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:02.229634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:02.229923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:02.230205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:02.230931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:02.232354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:02.244602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:02.245592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:43:02.246462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:02.248899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 502/985] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:43:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:02.252089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f34d15-bbdd-407f-8ef8-3e06612c81a2 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:02.346273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:02.357755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f34d15-bbdd-407f-8ef8-3e06612c81a2 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:02.393444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:02.394113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:02.394396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:02.394672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:02.395373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:02.395678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:02.397663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:02.407033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 484/986] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:43:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:02.408685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:02.513830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4da06d-01d5-4a79-833d-89633b5e32d7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:02.527137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:02.549821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:02.550488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:02.550848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:02.551125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:02.551822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:02.552131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:02.553514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:02.563621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 503/987] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:43:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:02.565248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:02.669213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc28b8-89b8-44ce-93b1-288c642ca44f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:02.703915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf5352-274a-4a8d-9892-4de514ecfa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:02.704602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf5352-274a-4a8d-9892-4de514ecfa16 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:02.704894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf5352-274a-4a8d-9892-4de514ecfa16 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:02.705176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf5352-274a-4a8d-9892-4de514ecfa16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:02.705975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf5352-274a-4a8d-9892-4de514ecfa16 None admin] RBAC: Adding query filter params (interface=admin, service_id=eeb70e1e81764bc1a79bf46e5893bae7, region_id=RegionOne) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:02.706291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf5352-274a-4a8d-9892-4de514ecfa16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:02.707691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf5352-274a-4a8d-9892-4de514ecfa16 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:02.717324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 485/988] 10.222.0.59 () {56 vars in 1249 bytes} [Wed May 18 14:43:02 2022] GET /identity/v3/endpoints?service_id=eeb70e1e81764bc1a79bf46e5893bae7&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:02.718640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:02.820258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49435fd0-c2fe-4aeb-b5b5-366546c5459c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:02.853468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b30bcc-9724-4b66-afb2-6c0856e7a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:02.854160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b30bcc-9724-4b66-afb2-6c0856e7a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:02.854443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b30bcc-9724-4b66-afb2-6c0856e7a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:02.854725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b30bcc-9724-4b66-afb2-6c0856e7a7e4 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:02.855421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b30bcc-9724-4b66-afb2-6c0856e7a7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:02.856871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b30bcc-9724-4b66-afb2-6c0856e7a7e4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:02.864157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 504/989] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:43:02 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:43:03.048769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98263-1fe1-4430-b824-405908e28b53 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.049277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98263-1fe1-4430-b824-405908e28b53 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.049370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98263-1fe1-4430-b824-405908e28b53 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.050861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 486/990] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:03.056502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5738bb-b3a1-482a-9035-32d84cca2ffc None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.056980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5738bb-b3a1-482a-9035-32d84cca2ffc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.057129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5738bb-b3a1-482a-9035-32d84cca2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.077694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9d5738bb-b3a1-482a-9035-32d84cca2ffc None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:03.078834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9d5738bb-b3a1-482a-9035-32d84cca2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:03.114714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:03.149811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 505/991] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:03.172672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98263-1fe1-4430-b824-405908e28b53 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:03.195919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:03.291912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98263-1fe1-4430-b824-405908e28b53 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:03.326691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548ab0d-7a2b-479d-bc38-29576d39f82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:03.327495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548ab0d-7a2b-479d-bc38-29576d39f82d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.327835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548ab0d-7a2b-479d-bc38-29576d39f82d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.328062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548ab0d-7a2b-479d-bc38-29576d39f82d None admin] PATH_INFO: `/v3/services/image` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.328747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548ab0d-7a2b-479d-bc38-29576d39f82d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:03.330134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548ab0d-7a2b-479d-bc38-29576d39f82d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-c548ab0d-7a2b-479d-bc38-29576d39f82d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:03.342245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:03.343252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:03.344121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:03.348461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 487/992] 10.222.0.59 () {56 vars in 1105 bytes} [Wed May 18 14:43:03 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:03.350339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5738bb-b3a1-482a-9035-32d84cca2ffc None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:03.426448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebd71d-78e3-4385-90aa-ee8c64a6be0c None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.426730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebd71d-78e3-4385-90aa-ee8c64a6be0c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.427015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebd71d-78e3-4385-90aa-ee8c64a6be0c None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.428956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 488/993] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:43:03.433781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2a5ac-23af-4a52-8c7d-7b23991ba00f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.434068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2a5ac-23af-4a52-8c7d-7b23991ba00f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.434346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2a5ac-23af-4a52-8c7d-7b23991ba00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.451811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-24e2a5ac-23af-4a52-8c7d-7b23991ba00f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:03.453077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-24e2a5ac-23af-4a52-8c7d-7b23991ba00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:03.453446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5738bb-b3a1-482a-9035-32d84cca2ffc None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:03.490437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:03.491104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.491388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.491665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.492441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] RBAC: Adding query filter params (name=image) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:03.492787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:03.494178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:03.498909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 506/994] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:03.504249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:03.532622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 489/995] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:03.543698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:03.552070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2a5ac-23af-4a52-8c7d-7b23991ba00f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:03.566039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:03.619681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aa737-80e0-447c-bfd9-0c0a0185fae4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:03.654044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:03.654707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.654990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.655270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.655969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] RBAC: Adding query filter params (type=image) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:03.656281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:03.657713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:03.663020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 507/996] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:03.671090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2a5ac-23af-4a52-8c7d-7b23991ba00f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:03.710618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:03.711437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.711726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.712002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.712698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:03.714103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:03.727799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:03.729294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:03.730159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 490/997] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:43:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:03.735335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:03.839184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:03.843637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1ab6e-0067-4790-82a6-5dc9c4089878 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:03.883402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:03.883972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:03.884256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:03.884539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:03.885303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:03.885615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:03.886994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:03.892191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 508/998] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:43:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:03.898256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:03.978312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:04.003376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae7ac7-3d2a-4336-9acb-617f6998f782 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:04.038855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:04.039523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:04.039808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:04.040088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:04.040827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:04.041139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:04.042522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:04.052312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 491/999] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:43:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:04.053567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:04.153840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d259cd-4aff-460d-8934-dfada28955d0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:04.195038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b3853-7e47-451b-a88f-490040e9413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:04.195038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b3853-7e47-451b-a88f-490040e9413b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:04.195038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b3853-7e47-451b-a88f-490040e9413b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:04.195038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b3853-7e47-451b-a88f-490040e9413b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:04.195603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b3853-7e47-451b-a88f-490040e9413b None admin] RBAC: Adding query filter params (interface=public, service_id=7a39ea845bd54465b9743198b7f01adb, region_id=RegionOne) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:04.195898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b3853-7e47-451b-a88f-490040e9413b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:04.197310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b3853-7e47-451b-a88f-490040e9413b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:04.206884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 509/1000] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:43:04 2022] GET /identity/v3/endpoints?service_id=7a39ea845bd54465b9743198b7f01adb&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:04.208470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:04.316960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87836654-00fc-4391-96a9-55e1aee74c07 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:04.354773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bdb24-200c-4be4-84b9-a1ada8e1a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:04.355444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bdb24-200c-4be4-84b9-a1ada8e1a545 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:04.355729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bdb24-200c-4be4-84b9-a1ada8e1a545 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:04.356006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bdb24-200c-4be4-84b9-a1ada8e1a545 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:04.356711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bdb24-200c-4be4-84b9-a1ada8e1a545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:04.358090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bdb24-200c-4be4-84b9-a1ada8e1a545 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:04.372617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 492/1001] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:43:04 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:43:05.126120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc665-43ec-4e55-9f53-aa9dd6accb8f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.126476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc665-43ec-4e55-9f53-aa9dd6accb8f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.126694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc665-43ec-4e55-9f53-aa9dd6accb8f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.128220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 510/1002] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:05.133422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb136-06bb-4eef-bff9-9c1eeee7c407 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.133848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb136-06bb-4eef-bff9-9c1eeee7c407 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.134033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb136-06bb-4eef-bff9-9c1eeee7c407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.139943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:05.152463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-fb2bb136-06bb-4eef-bff9-9c1eeee7c407 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:05.153693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-fb2bb136-06bb-4eef-bff9-9c1eeee7c407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:05.229013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 493/1003] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:05.251437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfc665-43ec-4e55-9f53-aa9dd6accb8f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:05.279859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:05.359125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfc665-43ec-4e55-9f53-aa9dd6accb8f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:05.393391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:05.394179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.394470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.394753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.395466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:05.397443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:05.409709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:05.410723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:05.412464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 511/1004] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 18 14:43:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:05.420092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bb136-06bb-4eef-bff9-9c1eeee7c407 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:05.526663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bb136-06bb-4eef-bff9-9c1eeee7c407 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:05.561959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:05.562633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.562918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.563194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.563894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:05.564199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:05.565623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:05.566851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:05.572738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 494/1005] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:43:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:05.577203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:05.673796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:05.685227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa8c7-f59b-46d5-8e5f-6500116accbb None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:05.718636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3196f4-3313-45b4-a369-f3717461629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:05.719299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3196f4-3313-45b4-a369-f3717461629a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.719584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3196f4-3313-45b4-a369-f3717461629a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.719863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3196f4-3313-45b4-a369-f3717461629a None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.720561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3196f4-3313-45b4-a369-f3717461629a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:05.720897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3196f4-3313-45b4-a369-f3717461629a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:05.722265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3196f4-3313-45b4-a369-f3717461629a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:05.732253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 512/1006] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 18 14:43:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:05.733797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:05.837403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5bda3-8c8c-4842-ba48-e56b00ed9f55 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:05.871067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f4a1c-0002-4cc8-bad3-26b3ee14fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:05.871729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f4a1c-0002-4cc8-bad3-26b3ee14fdb7 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.872012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f4a1c-0002-4cc8-bad3-26b3ee14fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.872290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f4a1c-0002-4cc8-bad3-26b3ee14fdb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.873051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f4a1c-0002-4cc8-bad3-26b3ee14fdb7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:05.874440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f4a1c-0002-4cc8-bad3-26b3ee14fdb7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:05.896623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 495/1007] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:43:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:43:05.948241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27277c-c8b8-4f4a-893d-38fd929fe21f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.948598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27277c-c8b8-4f4a-893d-38fd929fe21f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.948947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27277c-c8b8-4f4a-893d-38fd929fe21f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.950666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 513/1008] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:05.956446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf0a33-85cb-4783-bcab-e3765cfc4c21 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:05.956823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf0a33-85cb-4783-bcab-e3765cfc4c21 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:05.957077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf0a33-85cb-4783-bcab-e3765cfc4c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:05.976128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f5cf0a33-85cb-4783-bcab-e3765cfc4c21 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:05.977441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f5cf0a33-85cb-4783-bcab-e3765cfc4c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:06.037848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:06.060631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 496/1009] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:06.085035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27277c-c8b8-4f4a-893d-38fd929fe21f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:06.191944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27277c-c8b8-4f4a-893d-38fd929fe21f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:06.229760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033e5d-c29a-4301-afe5-53fb71af8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:06.230433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033e5d-c29a-4301-afe5-53fb71af8a66 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:06.230717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033e5d-c29a-4301-afe5-53fb71af8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:06.230993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033e5d-c29a-4301-afe5-53fb71af8a66 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:06.231711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d033e5d-c29a-4301-afe5-53fb71af8a66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:06.233122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d033e5d-c29a-4301-afe5-53fb71af8a66 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:06.248039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 514/1010] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:43:06 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:43:06.604088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e17a-300a-4f79-a94f-d11d0b36e64a None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:06.604617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e17a-300a-4f79-a94f-d11d0b36e64a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:06.604617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e17a-300a-4f79-a94f-d11d0b36e64a None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:06.606123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 497/1011] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:06.611168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c893-113e-4da9-a2b7-70cd13e5d380 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:06.611558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c893-113e-4da9-a2b7-70cd13e5d380 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:06.611739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c893-113e-4da9-a2b7-70cd13e5d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:06.628927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8218c893-113e-4da9-a2b7-70cd13e5d380 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:06.630135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8218c893-113e-4da9-a2b7-70cd13e5d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:06.640558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:06.712630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 515/1012] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:06 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:06.741847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e17a-300a-4f79-a94f-d11d0b36e64a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:06.844220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e17a-300a-4f79-a94f-d11d0b36e64a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:06.878464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:06.879200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:06.879489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:06.879769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:06.880467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:06.881882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:06.893619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:06.894622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:06.900520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 498/1013] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:43:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:06.902880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218c893-113e-4da9-a2b7-70cd13e5d380 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:07.004111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218c893-113e-4da9-a2b7-70cd13e5d380 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:07.038681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:07.039422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:07.039713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:07.039991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:07.040745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:07.041060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:07.042493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:07.053994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 516/1014] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:43:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:07.055710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:07.116148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:07.170524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fb0e0-e258-4bb1-beef-731117557888 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:07.206103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c667021-b861-4af4-9003-2ca27280a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:07.206779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667021-b861-4af4-9003-2ca27280a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:07.207067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667021-b861-4af4-9003-2ca27280a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:07.207408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667021-b861-4af4-9003-2ca27280a2e6 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:07.209304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667021-b861-4af4-9003-2ca27280a2e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:07.209304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667021-b861-4af4-9003-2ca27280a2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:07.211756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667021-b861-4af4-9003-2ca27280a2e6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:07.220183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 499/1015] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 18 14:43:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:07.221572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:07.226093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:07.325060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13396e-c89d-4f47-be4d-6be2564f7b23 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:07.361157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f502b-61d8-48ca-839e-5f0b3d9763b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:07.361824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f502b-61d8-48ca-839e-5f0b3d9763b3 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:07.362113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f502b-61d8-48ca-839e-5f0b3d9763b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:07.362394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f502b-61d8-48ca-839e-5f0b3d9763b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:07.363147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f502b-61d8-48ca-839e-5f0b3d9763b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:07.364634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f502b-61d8-48ca-839e-5f0b3d9763b3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:07.386644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 517/1016] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:43:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:43:08.149441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195af60-ebaa-4206-9fb3-27b098d1b0fb None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.149963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195af60-ebaa-4206-9fb3-27b098d1b0fb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.150085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195af60-ebaa-4206-9fb3-27b098d1b0fb None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.151527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 500/1017] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:08.156538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bb7d-626c-4317-b5ef-1d30a70ff6cb None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.156956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bb7d-626c-4317-b5ef-1d30a70ff6cb None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.157131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bb7d-626c-4317-b5ef-1d30a70ff6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.174071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e946bb7d-626c-4317-b5ef-1d30a70ff6cb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:08.175238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e946bb7d-626c-4317-b5ef-1d30a70ff6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:08.239253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:08.259095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 518/1018] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:08.281743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195af60-ebaa-4206-9fb3-27b098d1b0fb None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:08.391823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195af60-ebaa-4206-9fb3-27b098d1b0fb None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:08.405041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:08.428230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8bfd-e6e5-48b7-b78f-10c4af259b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:08.429404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8bfd-e6e5-48b7-b78f-10c4af259b76 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.429914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8bfd-e6e5-48b7-b78f-10c4af259b76 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.430391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8bfd-e6e5-48b7-b78f-10c4af259b76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.431791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b8bfd-e6e5-48b7-b78f-10c4af259b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:08.433481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b8bfd-e6e5-48b7-b78f-10c4af259b76 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:08.435650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 501/1019] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:08.441041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bb7d-626c-4317-b5ef-1d30a70ff6cb None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:08.486299 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d0270-dee6-4ffc-a84a-613cee7513e1 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.486589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d0270-dee6-4ffc-a84a-613cee7513e1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.486860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d0270-dee6-4ffc-a84a-613cee7513e1 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.488223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 502/1020] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:43:08.493917 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95f9f-bd1c-4969-8bd0-045bb63530df None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.494204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95f9f-bd1c-4969-8bd0-045bb63530df None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.494483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95f9f-bd1c-4969-8bd0-045bb63530df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.511101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-03f95f9f-bd1c-4969-8bd0-045bb63530df None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:08.512272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-03f95f9f-bd1c-4969-8bd0-045bb63530df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:08.548085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bb7d-626c-4317-b5ef-1d30a70ff6cb None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:08.583055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 503/1021] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:08.586557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:08.587535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.588017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.588499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.589793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:08.592131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:08.606217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95f9f-bd1c-4969-8bd0-045bb63530df None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:08.621966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 519/1022] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:43:08 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:43:08.719001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95f9f-bd1c-4969-8bd0-045bb63530df None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:08.731591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:08.757898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:08.758731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.759021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.759303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] PATH_INFO: `/v3/services/image` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.759971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:08.761527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:08.774735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:08.775828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:08.781790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 504/1023] 10.222.0.59 () {56 vars in 1105 bytes} [Wed May 18 14:43:08 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:08.782601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:08.827302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:08.893224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2766-7e7d-4e61-8e2a-7e51418b0a10 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:08.928785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:08.929454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:08.929742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:08.930025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:08.930733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:08.931045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:08.932422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:08.937580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 520/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:08.943007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:09.046259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdef6a-cc03-4162-9520-86dccd1ce806 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:09.079513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:09.080174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:09.080461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:09.080764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:09.081460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] RBAC: Adding query filter params (type=image) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:09.081765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:09.083133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:09.088984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 505/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:09.094506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:09.200621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a6e0f-00d0-41df-8977-c2ba8281e6c6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:09.202305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:09.237995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd3f4c-5e45-4308-8803-6c44ae16a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:09.238653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3f4c-5e45-4308-8803-6c44ae16a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:09.238934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3f4c-5e45-4308-8803-6c44ae16a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:09.239208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3f4c-5e45-4308-8803-6c44ae16a1f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:09.240024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd3f4c-5e45-4308-8803-6c44ae16a1f1 None admin] RBAC: Adding query filter params (interface=public, service_id=4e2e18cab24f480ea6bab5e122efeff2, region_id=RegionOne) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:09.240335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd3f4c-5e45-4308-8803-6c44ae16a1f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:09.241719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd3f4c-5e45-4308-8803-6c44ae16a1f1 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:09.247150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 521/1026] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:43:09 2022] GET /identity/v3/endpoints?service_id=4e2e18cab24f480ea6bab5e122efeff2&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:09.252425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:09.294762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:09.356492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae48ba2-bddd-4f68-860d-51def6b92eb2 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:09.390368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e1fae-1f3d-4c34-b5a5-509f38ca644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:09.391036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1fae-1f3d-4c34-b5a5-509f38ca644e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:09.391318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1fae-1f3d-4c34-b5a5-509f38ca644e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:09.391594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1fae-1f3d-4c34-b5a5-509f38ca644e None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:09.392274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e1fae-1f3d-4c34-b5a5-509f38ca644e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:09.393683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e1fae-1f3d-4c34-b5a5-509f38ca644e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:09.403939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 506/1027] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:43:09 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:43:09.701241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0da095-d90e-483f-bdd2-ce62036e82cd None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:09.701625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0da095-d90e-483f-bdd2-ce62036e82cd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:09.701933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0da095-d90e-483f-bdd2-ce62036e82cd None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:09.703840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 522/1028] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:09.709132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61697f4-dfb3-41af-b2c6-8fc76e5289d9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:09.709426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61697f4-dfb3-41af-b2c6-8fc76e5289d9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:09.709710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61697f4-dfb3-41af-b2c6-8fc76e5289d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:09.726193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b61697f4-dfb3-41af-b2c6-8fc76e5289d9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:09.727354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b61697f4-dfb3-41af-b2c6-8fc76e5289d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:09.796676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 507/1029] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:09.820180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0da095-d90e-483f-bdd2-ce62036e82cd None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:09.924608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0da095-d90e-483f-bdd2-ce62036e82cd None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:09.959530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:09.960331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:09.960641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:09.960950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:09.971587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:09.980363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:09.981385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:09.982930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 523/1030] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 18 14:43:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:09.988628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61697f4-dfb3-41af-b2c6-8fc76e5289d9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:10.019230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:10.089845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61697f4-dfb3-41af-b2c6-8fc76e5289d9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:10.122496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:10.123163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.123442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.123714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.124450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:10.124795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:10.126182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:10.139227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 508/1031] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 18 14:43:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:10.140463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:10.169283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:10.250447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401213d1-7dc5-4584-8453-fccec70be0be None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:10.285433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:10.286232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.286550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.286831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.297298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:10.298744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:10.316789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:10.318263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:10.319186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:43:10.319186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:10.319186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:10.319186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:10.319976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 524/1032] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:10.324215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:10.418323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:10.426243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90138c55-532d-421d-adc2-552106f8e113 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:10.460069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:10.460756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.461040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.461317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.462030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:10.462336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:10.463765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:10.480097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 509/1033] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:10.481450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:10.565792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:10.588616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954b74-895a-47dd-91df-727cd2ac8fd6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:10.623731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:10.624618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.624909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.625188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.632664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:10.634197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:43:10.648724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:10.649690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:10.650675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 525/1034] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:43:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:10.655712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:10.776719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09307a54-fd1b-43ef-8a41-242c7eda16f4 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:10.818980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3f746-e8a8-415d-ba59-63d20151098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:10.819652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3f746-e8a8-415d-ba59-63d20151098a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.819933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3f746-e8a8-415d-ba59-63d20151098a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.820207 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3f746-e8a8-415d-ba59-63d20151098a None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.821062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3f746-e8a8-415d-ba59-63d20151098a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:10.821371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3f746-e8a8-415d-ba59-63d20151098a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:10.822797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3f746-e8a8-415d-ba59-63d20151098a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:10.844398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 510/1035] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:43:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:10.845620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:10.915284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba409-dbd1-41d0-a8fa-ef5933273ad0 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.915579 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba409-dbd1-41d0-a8fa-ef5933273ad0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.915867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba409-dbd1-41d0-a8fa-ef5933273ad0 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.917407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 511/1036] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:43:10.922458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e950-e9ed-4a6c-9edb-5f5900093027 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.922750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e950-e9ed-4a6c-9edb-5f5900093027 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.923034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e950-e9ed-4a6c-9edb-5f5900093027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.939794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f568e950-e9ed-4a6c-9edb-5f5900093027 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:10.940993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f568e950-e9ed-4a6c-9edb-5f5900093027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:10.945755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832567d4-29c4-4c43-a541-d1a8602da784 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:10.949830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:10.981263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:10.981911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:10.982195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:10.982469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:10.990575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:11.015213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 512/1037] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:43:11.039897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568e950-e9ed-4a6c-9edb-5f5900093027 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.055954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.057663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.150999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568e950-e9ed-4a6c-9edb-5f5900093027 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:11.180808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 526/1038] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:11.186226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.196089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:11.196955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.197241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.197522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.198709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.200169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.201823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 513/1039] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:11.207236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.221518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:11.233188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:11.298791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18356ea4-821a-4197-b02f-e6accee9f6e1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:11.319545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c78d5-efe1-4651-ac53-1b8260f43324 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:11.337702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:11.338519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.338805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.339088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.349322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.350755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.358585 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:11.360245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.360993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.361463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.362358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.363988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:11.368878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:11.369850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:11.375750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:43:11.375750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:11.375750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:11.375750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:11.375750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 527/1040] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:11.375750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.400613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 514/1041] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:43:11 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:43:11.482808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:11.495179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c6abb-90db-45cf-a998-6895f0f0796b None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:11.533391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633161a9-7e2c-4afa-af4c-1acba8f9af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:11.534081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633161a9-7e2c-4afa-af4c-1acba8f9af9d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.534370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633161a9-7e2c-4afa-af4c-1acba8f9af9d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.534652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633161a9-7e2c-4afa-af4c-1acba8f9af9d None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.535390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633161a9-7e2c-4afa-af4c-1acba8f9af9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:11.535702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633161a9-7e2c-4afa-af4c-1acba8f9af9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.537200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633161a9-7e2c-4afa-af4c-1acba8f9af9d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.550417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 528/1042] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:11.560608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.627413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:11.666428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce71b24-5787-427f-9519-2fb1fa0ce53c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.666948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce71b24-5787-427f-9519-2fb1fa0ce53c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.667113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce71b24-5787-427f-9519-2fb1fa0ce53c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.668836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 529/1043] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:43:11.670030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc8e88-853e-4307-89c6-f733299ae84d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:11.674446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224da8-7a85-4759-974e-9348e3dbb33c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.674739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224da8-7a85-4759-974e-9348e3dbb33c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.675026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224da8-7a85-4759-974e-9348e3dbb33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.696148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-12224da8-7a85-4759-974e-9348e3dbb33c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:11.697298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-12224da8-7a85-4759-974e-9348e3dbb33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:11.706420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:11.707344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.707633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.707915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.718081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.719681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:43:11.737163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:11.738143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:11.739055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:11.740737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 515/1044] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:11.744660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.772617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 530/1045] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:43:11.790910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224da8-7a85-4759-974e-9348e3dbb33c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.851297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153ec3-7c96-4b5b-b503-33b49693031e None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:11.878257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:11.880700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:11.891713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:11.892568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.893056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.893489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.894421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:11.894996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.896671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.900347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224da8-7a85-4759-974e-9348e3dbb33c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:11.908968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 516/1046] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:11.914772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:11.939027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:11.939822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:11.940110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:11.940389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] PATH_INFO: `/v3/services/image` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:11.941082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:11.942517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:11.955370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:11.956445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 14:43:11.957384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:11.961654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 531/1047] 10.222.0.59 () {56 vars in 1105 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:11.962404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:12.023157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576b4d9-eb86-4ec5-a89e-20eda4e650f0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:12.061082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:12.061741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:12.062441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:12.062732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:12.063565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] RBAC: Adding query filter params (role.id=5abc12b86c294392abccf8fa7ac5a038, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=06274e1b42f6471cac81889ec673a222) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:12.063880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:12.065555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:12.076620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 517/1048] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/role_assignments?user.id=06274e1b42f6471cac81889ec673a222&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=5abc12b86c294392abccf8fa7ac5a038 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:12.076810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe7acc-ff1f-42ea-8726-b6fcfcd41a86 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:12.112959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:12.113560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:12.113850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:12.114131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:12.115426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] RBAC: Adding query filter params (name=image) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:12.115736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:12.117161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:12.127461 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 532/1049] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:12.130154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:12.187028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:12.250972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef69081-ec8c-49b4-bb17-fa4e1fab8de8 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:12.286978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd589-ecb0-4662-8e8a-fad69f17e092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:12.287650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd589-ecb0-4662-8e8a-fad69f17e092 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:12.287937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd589-ecb0-4662-8e8a-fad69f17e092 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:12.288215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd589-ecb0-4662-8e8a-fad69f17e092 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:12.288956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd589-ecb0-4662-8e8a-fad69f17e092 None admin] RBAC: Adding query filter params (type=image) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:12.289267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd589-ecb0-4662-8e8a-fad69f17e092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:12.290648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd589-ecb0-4662-8e8a-fad69f17e092 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:12.296000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 518/1050] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:12.301999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:12.314046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:12.403935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b03f-e412-4c01-8c4b-adda2cd9eb92 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:12.439399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbab3e2-0e6d-4846-97a1-ded652ae7463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:12.440063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab3e2-0e6d-4846-97a1-ded652ae7463 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:12.440352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab3e2-0e6d-4846-97a1-ded652ae7463 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:12.440671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab3e2-0e6d-4846-97a1-ded652ae7463 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:12.441409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbab3e2-0e6d-4846-97a1-ded652ae7463 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:12.442815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbab3e2-0e6d-4846-97a1-ded652ae7463 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:12.468628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 533/1051] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:43:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:43:13.711513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369636-a08a-4262-a5f5-15f070971b17 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:13.712019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369636-a08a-4262-a5f5-15f070971b17 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:13.712098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369636-a08a-4262-a5f5-15f070971b17 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:13.713595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 519/1052] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:13.718767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279cd9-18fc-48c8-9f9d-1a584dc8c3eb None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:13.719184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279cd9-18fc-48c8-9f9d-1a584dc8c3eb None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:13.719387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279cd9-18fc-48c8-9f9d-1a584dc8c3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:13.737249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-12279cd9-18fc-48c8-9f9d-1a584dc8c3eb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:13.738428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-12279cd9-18fc-48c8-9f9d-1a584dc8c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:13.799847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:13.816529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 534/1053] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:13.851989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369636-a08a-4262-a5f5-15f070971b17 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:13.965892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7369636-a08a-4262-a5f5-15f070971b17 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:13.979715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:14.000958 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.002064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.002567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.003040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.014473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:14.022358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:14.023293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:14.024165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:14.026072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 520/1054] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:43:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:14.031905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12279cd9-18fc-48c8-9f9d-1a584dc8c3eb None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.137462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12279cd9-18fc-48c8-9f9d-1a584dc8c3eb None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:14.171612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15663c-411b-49e7-a153-9872bf78bb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.172286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15663c-411b-49e7-a153-9872bf78bb42 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.172572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15663c-411b-49e7-a153-9872bf78bb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.172881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15663c-411b-49e7-a153-9872bf78bb42 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.173629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15663c-411b-49e7-a153-9872bf78bb42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:14.173937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15663c-411b-49e7-a153-9872bf78bb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:14.175318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15663c-411b-49e7-a153-9872bf78bb42 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:14.188699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 535/1055] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:14.192095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.299237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8c495-35d2-4c0b-b545-1e627c824671 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.299533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8c495-35d2-4c0b-b545-1e627c824671 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.299735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8c495-35d2-4c0b-b545-1e627c824671 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.301164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 536/1056] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:14.306715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f2109-b8ee-4f18-acce-fa9cedc5adae None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.307076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f2109-b8ee-4f18-acce-fa9cedc5adae None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.307368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f2109-b8ee-4f18-acce-fa9cedc5adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.311411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfae2-7239-406f-9cc6-52b89fdb626f None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:14.324284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-6f1f2109-b8ee-4f18-acce-fa9cedc5adae None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:14.325504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-6f1f2109-b8ee-4f18-acce-fa9cedc5adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:14.349343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.350441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.350807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.350989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] PATH_INFO: `/v3/users/3992b527637e4cda8db9457dfffa512e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.365878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] RBAC: Authorizing `identity:get_user(user_id=3992b527637e4cda8db9457dfffa512e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:14.367414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:14.369179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 521/1057] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/users/3992b527637e4cda8db9457dfffa512e => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:14.374660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.382789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:14.404781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 537/1058] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:43:14.407486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:14.431434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f2109-b8ee-4f18-acce-fa9cedc5adae None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.481096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e16186-e142-4afa-a7b8-20adb654e01c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:14.518376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.519361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.519828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.520283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.534539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f2109-b8ee-4f18-acce-fa9cedc5adae None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:14.572745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.573471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.573782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.574040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.586795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:14.595366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:14.596614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:14.597493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 538/1059] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:14.601523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:14.603021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:14.603220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.635723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:14.653738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:14.711777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 522/1060] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 14:43:14.717343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9769b-f39b-4f82-9939-f74fac3635d1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:14.717491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.756475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37cc4b-362a-4548-8579-900ee6cb440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.757180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37cc4b-362a-4548-8579-900ee6cb440d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.757470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37cc4b-362a-4548-8579-900ee6cb440d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.757751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37cc4b-362a-4548-8579-900ee6cb440d None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.758505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37cc4b-362a-4548-8579-900ee6cb440d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:14.758817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37cc4b-362a-4548-8579-900ee6cb440d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:14.760188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37cc4b-362a-4548-8579-900ee6cb440d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:14.768230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 539/1061] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:14.771894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8918cc-7f50-42ca-a536-4b9ef14d66f5 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.771894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8918cc-7f50-42ca-a536-4b9ef14d66f5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.771894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8918cc-7f50-42ca-a536-4b9ef14d66f5 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.771894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 540/1062] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:14.775734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8918cc-7f50-42ca-a536-4b9ef14d66f5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.818536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376525dd-1628-4e70-ab87-2cb339a7e477 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:14.847389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:14.853231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de76d1-7efc-4081-940d-a29978e1d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.854095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de76d1-7efc-4081-940d-a29978e1d4bb None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.854378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de76d1-7efc-4081-940d-a29978e1d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.854653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de76d1-7efc-4081-940d-a29978e1d4bb None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.855842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de76d1-7efc-4081-940d-a29978e1d4bb None admin] RBAC: Authorizing `identity:get_project(project_id=4d2c3d8e4ef64b6e859233793dd0341c)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:14.857325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de76d1-7efc-4081-940d-a29978e1d4bb None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:14.859002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 523/1063] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:14.860138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4401615-dcaf-4404-93c0-ebd0e6885c10 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.860422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4401615-dcaf-4404-93c0-ebd0e6885c10 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.860726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4401615-dcaf-4404-93c0-ebd0e6885c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.877287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c4401615-dcaf-4404-93c0-ebd0e6885c10 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:14.878476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c4401615-dcaf-4404-93c0-ebd0e6885c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:14.886101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8918cc-7f50-42ca-a536-4b9ef14d66f5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:14.888414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:14.920412 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:14.921236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:14.921522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:14.921803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:14.932758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:14.934197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:14.944888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 524/1064] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:14.945712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4401615-dcaf-4404-93c0-ebd0e6885c10 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:14.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:14.951706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:14.952685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:43:14.952685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:14.952685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:14.952685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:14.952685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 541/1065] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:14.967683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.045684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4401615-dcaf-4404-93c0-ebd0e6885c10 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.065185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cce8a5-52a8-4d6d-aea0-0305e6270f72 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.073646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:15.080057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.080741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.081030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.081302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.082129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c, user.id=3992b527637e4cda8db9457dfffa512e) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:15.082441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.084430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.089808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 525/1066] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/role_assignments?user.id=3992b527637e4cda8db9457dfffa512e&scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:15.089808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.099636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.099926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.100210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.100487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.101262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:15.101573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.102990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.120835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 542/1067] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:15.122058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.144279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:15.220074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637ae3e-3593-4330-a749-829c473c12b0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.245600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22ade-1e28-45c2-8bf0-83c1e518314c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.257253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.257920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.258212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.258490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.296117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.297351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.297486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.297690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.306139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.307788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.322723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:43:15.325538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:15.326485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:43:15.327918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:15.332068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 543/1068] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:15.332527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.333746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.334814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.421496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:15.440869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 526/1069] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:15.447337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.449902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba1a10-eeb7-49cc-bc48-25d21c5ee27f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.485252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.485924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.486210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.486492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.487327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:15.487645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.489104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.508689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 544/1070] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:15.514195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.549484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:15.559158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8d8e6-2598-4ecf-97c9-06bb5b8b2105 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.596595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.597452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.597739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.598022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.609759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.611234 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.624741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8883d3-0df1-47c1-b539-0803ddec517c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:15.630773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:15.631754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:15.637718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:43:15.637718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:15.637718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:15.637718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:15.637718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 527/1071] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:15.638024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.667575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.668374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.668768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.669053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.671273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:15.680954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.682348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:15.701227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:15.702341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:15.703271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:43:15.703271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:15.703271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:15.703271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:15.707077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 545/1072] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:15.707907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.748527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba37477-e7ee-4842-84ce-28b609c6bc32 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.790140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.791195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.791486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.791853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.792600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:15.792971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.794628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.807509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 528/1073] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:15.812824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e6f3-4e7f-43ba-977e-fce605c9633a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:15.852219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:15.852933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:15.853223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:15.853506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:15.854247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:15.854563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:15.855957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:15.872901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 546/1074] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:15.878495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:15.888825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:15.992224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7b37-c7b9-4309-9475-43b2ed0be270 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:16.028378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:16.029264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:16.029547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:16.029828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:16.037012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:16.038464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:43:16.053803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:16.054811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:16.056134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 529/1075] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:16.060809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:16.111399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:16.165854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c88425-f5b2-4d22-bb6c-7b4c33ca8fd0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:16.201113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdff3ef-0237-42b1-b969-a6c400151e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:16.201785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff3ef-0237-42b1-b969-a6c400151e8a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:16.202101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff3ef-0237-42b1-b969-a6c400151e8a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:16.202384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff3ef-0237-42b1-b969-a6c400151e8a None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:16.203176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff3ef-0237-42b1-b969-a6c400151e8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:16.203491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff3ef-0237-42b1-b969-a6c400151e8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:16.204950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff3ef-0237-42b1-b969-a6c400151e8a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:16.217861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 547/1076] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:16.223448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:16.288308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:16.322542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf67cc-61d3-404d-bb34-36915bdd206c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:16.356173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef726-2861-422e-a3d5-3e9abaab2b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:16.357101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef726-2861-422e-a3d5-3e9abaab2b9e None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:16.357385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef726-2861-422e-a3d5-3e9abaab2b9e None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:16.357663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef726-2861-422e-a3d5-3e9abaab2b9e None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/06274e1b42f6471cac81889ec673a222/roles/5abc12b86c294392abccf8fa7ac5a038` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:16.359846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ef726-2861-422e-a3d5-3e9abaab2b9e None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=06274e1b42f6471cac81889ec673a222, role_id=5abc12b86c294392abccf8fa7ac5a038)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:16.361334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ef726-2861-422e-a3d5-3e9abaab2b9e None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:16.374604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 530/1077] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:43:16 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/06274e1b42f6471cac81889ec673a222/roles/5abc12b86c294392abccf8fa7ac5a038 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:43:17.291818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55821f-8654-43f0-8fe8-a7bdeba1103d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:17.292338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55821f-8654-43f0-8fe8-a7bdeba1103d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:17.292441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55821f-8654-43f0-8fe8-a7bdeba1103d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:17.293796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 548/1078] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:17.299250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f8c0-47a2-497b-8b22-c18faec96eb6 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:17.299642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f8c0-47a2-497b-8b22-c18faec96eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:17.299817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f8c0-47a2-497b-8b22-c18faec96eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:17.316832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2db3f8c0-47a2-497b-8b22-c18faec96eb6 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:17.318016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2db3f8c0-47a2-497b-8b22-c18faec96eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:17.382215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 531/1079] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:17.404229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55821f-8654-43f0-8fe8-a7bdeba1103d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:17.505470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55821f-8654-43f0-8fe8-a7bdeba1103d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:17.512545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:17.539460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:17.540255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:17.540542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:17.540856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:17.551125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:17.559474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:17.560606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:17.561501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 549/1080] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:17.566759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3f8c0-47a2-497b-8b22-c18faec96eb6 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:17.621958 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:17.672989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3f8c0-47a2-497b-8b22-c18faec96eb6 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:17.706492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:17.707161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:17.707449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:17.707735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:17.709033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:17.709348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:17.710733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:17.718816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 532/1081] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:17.725093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:17.824999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e5bd-018a-4290-9624-b46b8a6bb277 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:17.858323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:17.859193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:17.859479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:17.859757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] PATH_INFO: `/v3/users/3992b527637e4cda8db9457dfffa512e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:17.860979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] RBAC: Authorizing `identity:get_user(user_id=3992b527637e4cda8db9457dfffa512e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:17.862419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:17.864042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 550/1082] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:17 2022] GET /identity/v3/users/3992b527637e4cda8db9457dfffa512e => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:17.869648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:17.969277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2dd0b-69f0-4519-84f4-10ec1779cdaf None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:17.988052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:18.007761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41129e9c-179b-42c9-8067-4fb544fedc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:18.008681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41129e9c-179b-42c9-8067-4fb544fedc11 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:18.008966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41129e9c-179b-42c9-8067-4fb544fedc11 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:18.009248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41129e9c-179b-42c9-8067-4fb544fedc11 None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:18.010474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41129e9c-179b-42c9-8067-4fb544fedc11 None admin] RBAC: Authorizing `identity:get_project(project_id=4d2c3d8e4ef64b6e859233793dd0341c)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:18.011926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41129e9c-179b-42c9-8067-4fb544fedc11 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:18.013672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 533/1083] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:17 2022] GET /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:18.019583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:18.054568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:18.118954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5cad4-d009-4c28-8ad4-d3bdf77c4cce None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:18.152233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb73649-0ffa-45ba-87ef-305f46c5674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:18.153159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb73649-0ffa-45ba-87ef-305f46c5674f None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:18.153450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb73649-0ffa-45ba-87ef-305f46c5674f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:18.153729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb73649-0ffa-45ba-87ef-305f46c5674f None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c/users/3992b527637e4cda8db9457dfffa512e/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:18.155701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb73649-0ffa-45ba-87ef-305f46c5674f None admin] RBAC: Authorizing `identity:create_grant(project_id=4d2c3d8e4ef64b6e859233793dd0341c, user_id=3992b527637e4cda8db9457dfffa512e, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:18.157182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb73649-0ffa-45ba-87ef-305f46c5674f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:18.170240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 551/1084] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:43:18 2022] PUT /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c/users/3992b527637e4cda8db9457dfffa512e/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:43:18.569582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051a21-d44a-470b-b077-8705e0901d78 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:18.570136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051a21-d44a-470b-b077-8705e0901d78 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:18.570136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051a21-d44a-470b-b077-8705e0901d78 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:18.571511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 534/1085] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:18.577219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272a0ae-6171-4039-a7da-acc531bd234e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:18.577654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272a0ae-6171-4039-a7da-acc531bd234e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:18.577792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272a0ae-6171-4039-a7da-acc531bd234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:18.594973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1272a0ae-6171-4039-a7da-acc531bd234e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:18.596167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1272a0ae-6171-4039-a7da-acc531bd234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:18.661167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 552/1086] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:18.684879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051a21-d44a-470b-b077-8705e0901d78 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:18.785350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051a21-d44a-470b-b077-8705e0901d78 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:18.818927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:18.819782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:18.820015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:18.820290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:18.830867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:18.839005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:18.839992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:18.840898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 535/1087] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 18 14:43:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:18.846207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272a0ae-6171-4039-a7da-acc531bd234e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:18.871031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:18.944066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272a0ae-6171-4039-a7da-acc531bd234e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:18.977590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:18.978260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:18.978545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:18.978821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:18.979626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:18.979941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:18.981342 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:18.989968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 553/1088] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 18 14:43:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:18.995316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:19.041276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:19.094754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c66d5-db52-4b59-842c-003006dccdc1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:19.128132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:19.128962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:19.129250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:19.129529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:19.139318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:19.140811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:19.157995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:19.158899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:19.160038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:43:19.160038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:19.160038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:19.160038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:19.160038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 536/1089] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:19.165378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:19.250040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:19.266110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc50166-1c78-40e2-b9e2-06847f73c180 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:19.300835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:19.301498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:19.301815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:19.302098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:19.302818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:19.303130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:19.304491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:19.316020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 554/1090] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:19.321530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:19.417478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:19.422038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7366c6c-0739-4f8c-9079-f47557598c25 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:19.454935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:19.455718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:19.456000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:19.456276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:19.463984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:19.465456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:43:19.479752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:19.480793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:19.481794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 537/1091] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 18 14:43:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:19.486789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:19.584572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2465340-9ed0-4eaa-af26-96c9b3d26e48 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:19.625344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:19.626025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:19.626312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:19.626594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:19.627427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:19.627744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:19.629213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:19.647095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 555/1092] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 18 14:43:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:19.652910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:19.750661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb4348-2d1e-4f75-9265-5227792662cc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:19.784050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:19.784741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:19.785029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:19.785308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:19.812297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:19.854859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:19.856335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:19.962389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 538/1093] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 14:43:19.968098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:19.972345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:20.088160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad42b5-a45b-4a7f-8a7d-ace802305ed9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.121317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235e50d-034d-477e-b954-e8656517341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.122105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e50d-034d-477e-b954-e8656517341a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.122388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e50d-034d-477e-b954-e8656517341a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.122663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e50d-034d-477e-b954-e8656517341a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.132992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235e50d-034d-477e-b954-e8656517341a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:20.134430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235e50d-034d-477e-b954-e8656517341a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-b235e50d-034d-477e-b954-e8656517341a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:20.151999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:20.153116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:20.154048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:43:20.154048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:20.154048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:43:20.154048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:20.154048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 556/1094] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:20.158780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:20.222702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:20.263655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249dee7-af56-4ad0-ac82-486af5c7a2cc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.296541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51433f-b8a5-4ec4-b198-8828fb857f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.297221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51433f-b8a5-4ec4-b198-8828fb857f74 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.297502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51433f-b8a5-4ec4-b198-8828fb857f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.297778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51433f-b8a5-4ec4-b198-8828fb857f74 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.298487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51433f-b8a5-4ec4-b198-8828fb857f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:20.298795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51433f-b8a5-4ec4-b198-8828fb857f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:20.300174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51433f-b8a5-4ec4-b198-8828fb857f74 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:20.311684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 539/1095] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:20.317153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235e50d-034d-477e-b954-e8656517341a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:20.381649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d292b3f-35e1-45d8-bc41-c9ec4fdff618 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.381864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d292b3f-35e1-45d8-bc41-c9ec4fdff618 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.382177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d292b3f-35e1-45d8-bc41-c9ec4fdff618 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.383546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 540/1096] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:43:20.385303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:20.388725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c96b7e-4b73-4fbb-814a-8336f5a02a5e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.389017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c96b7e-4b73-4fbb-814a-8336f5a02a5e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.389302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c96b7e-4b73-4fbb-814a-8336f5a02a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.405555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a9c96b7e-4b73-4fbb-814a-8336f5a02a5e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:20.406752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a9c96b7e-4b73-4fbb-814a-8336f5a02a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:20.431539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235e50d-034d-477e-b954-e8656517341a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.463957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.464779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.465055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.465328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.472574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:20.474559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:20.477249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 541/1097] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:43:20.488131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:20.489841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:20.495432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 557/1098] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:20.495940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c96b7e-4b73-4fbb-814a-8336f5a02a5e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:20.501283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:20.543271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:20.594641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c96b7e-4b73-4fbb-814a-8336f5a02a5e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.599115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561fa18-9e33-4f6b-8d4e-4440e62d51b2 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.615143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:20.629660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.630354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.630643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.630926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.631755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:20.632025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:20.632538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.633355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.633516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:20.633644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.633924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.644077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:20.644895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 542/1099] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:20.650691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:20.652068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:20.653057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:20.653913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 558/1100] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:43:20.658933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:20.753704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4ec5-b94d-4acc-ae0c-adba73dfd151 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.756346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba4dda-b957-4783-93f5-e021a0af1f0d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.762292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:20.788220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.788897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.789177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.789452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.789877 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.790271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] RBAC: Adding query filter params (role.id=5abc12b86c294392abccf8fa7ac5a038, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=06274e1b42f6471cac81889ec673a222) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:20.790543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.790638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:20.790828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.791107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.791849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:20.792013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:20.792159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:20.793557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:20.798280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 543/1101] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/role_assignments?user.id=06274e1b42f6471cac81889ec673a222&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=5abc12b86c294392abccf8fa7ac5a038 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:20.805984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 559/1102] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:43:20.807812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:20.912919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa7afa-ad64-452c-980d-0dfa80852559 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:20.947477 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:20.948374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:20.948683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:20.948961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] PATH_INFO: `/v3/users/3992b527637e4cda8db9457dfffa512e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:20.950301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] RBAC: Authorizing `identity:get_user(user_id=3992b527637e4cda8db9457dfffa512e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:20.952163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:20.954153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 544/1103] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/users/3992b527637e4cda8db9457dfffa512e => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:20.960559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:21.002182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:21.065150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec90ee-e6f7-4f11-836f-e2726d9988b5 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:21.100055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:21.100746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:21.101035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:21.101318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:21.170318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:21.171700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:21.210471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:21.271644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 560/1104] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:21.277542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:21.319886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:21.379434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed342-24a4-4042-81f0-4af0f4610c14 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:21.414544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441abe6-26df-4d5d-a63d-6efc90973dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:21.415428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441abe6-26df-4d5d-a63d-6efc90973dee None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:21.415694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441abe6-26df-4d5d-a63d-6efc90973dee None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:21.415967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441abe6-26df-4d5d-a63d-6efc90973dee None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:21.417169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441abe6-26df-4d5d-a63d-6efc90973dee None admin] RBAC: Authorizing `identity:get_project(project_id=4d2c3d8e4ef64b6e859233793dd0341c)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:21.418607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441abe6-26df-4d5d-a63d-6efc90973dee None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:21.420609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 545/1105] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:21 2022] GET /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:21.427378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:21.529747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124f6b-71f0-43ce-aec5-5a0c39a424aa None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:21.564428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8679766-90c4-4ab5-9fa9-59676cd786a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:21.565227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679766-90c4-4ab5-9fa9-59676cd786a2 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:21.565510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679766-90c4-4ab5-9fa9-59676cd786a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:21.565787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679766-90c4-4ab5-9fa9-59676cd786a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:21.566609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679766-90c4-4ab5-9fa9-59676cd786a2 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c, user.id=3992b527637e4cda8db9457dfffa512e) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:21.566917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679766-90c4-4ab5-9fa9-59676cd786a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:21.568983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679766-90c4-4ab5-9fa9-59676cd786a2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:21.574826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 561/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:21 2022] GET /identity/v3/role_assignments?user.id=3992b527637e4cda8db9457dfffa512e&scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:23.810848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f300-a419-4193-bed2-146f4d62718b None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:23.811373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f300-a419-4193-bed2-146f4d62718b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:23.811373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f300-a419-4193-bed2-146f4d62718b None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:23.812781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 546/1107] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:23.818563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b182a2-6082-4611-8b2d-9f2422d50d84 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:23.818999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b182a2-6082-4611-8b2d-9f2422d50d84 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:23.819153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b182a2-6082-4611-8b2d-9f2422d50d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:23.824144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:23.836916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-04b182a2-6082-4611-8b2d-9f2422d50d84 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:23.838110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-04b182a2-6082-4611-8b2d-9f2422d50d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:23.904789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 562/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:43:23.929734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f300-a419-4193-bed2-146f4d62718b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:24.028278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f300-a419-4193-bed2-146f4d62718b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:24.037252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:24.062314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf843ba1-4564-457c-844c-655eaeda107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:24.063034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf843ba1-4564-457c-844c-655eaeda107a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:24.063314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf843ba1-4564-457c-844c-655eaeda107a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:24.063590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf843ba1-4564-457c-844c-655eaeda107a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:24.064764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf843ba1-4564-457c-844c-655eaeda107a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:24.066197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf843ba1-4564-457c-844c-655eaeda107a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:24.067797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 547/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:24.073607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b182a2-6082-4611-8b2d-9f2422d50d84 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:24.169984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b182a2-6082-4611-8b2d-9f2422d50d84 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:24.198596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:24.203989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bad43-314b-49b5-9778-a4cdab21cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:24.204681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bad43-314b-49b5-9778-a4cdab21cb60 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:24.204965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bad43-314b-49b5-9778-a4cdab21cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:24.205237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bad43-314b-49b5-9778-a4cdab21cb60 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:24.205936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bad43-314b-49b5-9778-a4cdab21cb60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:24.207349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bad43-314b-49b5-9778-a4cdab21cb60 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:24.227034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 563/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:43:24 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:43:26.465350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616829ed-661c-4ed4-819e-0a84c25a7f4a None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:26.465848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616829ed-661c-4ed4-819e-0a84c25a7f4a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:26.466082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616829ed-661c-4ed4-819e-0a84c25a7f4a None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:26.468240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 548/1111] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:26.473561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9e4fb-6b79-4ba5-a7b5-48c1eb9c4dc4 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:26.473996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9e4fb-6b79-4ba5-a7b5-48c1eb9c4dc4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:26.474208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9e4fb-6b79-4ba5-a7b5-48c1eb9c4dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:26.490614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ecd9e4fb-6b79-4ba5-a7b5-48c1eb9c4dc4 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:26.491778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ecd9e4fb-6b79-4ba5-a7b5-48c1eb9c4dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:26.556637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 564/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:26.579683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616829ed-661c-4ed4-819e-0a84c25a7f4a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:26.678921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616829ed-661c-4ed4-819e-0a84c25a7f4a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:26.711296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:26.712150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:26.712436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:26.712749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] PATH_INFO: `/v3/roles/8888db000f97433e8f047879704f3916` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:26.714222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] RBAC: Authorizing `identity:get_role(role_id=8888db000f97433e8f047879704f3916)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:26.715638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:26.716964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 549/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:26 2022] GET /identity/v3/roles/8888db000f97433e8f047879704f3916 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:26.722407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9e4fb-6b79-4ba5-a7b5-48c1eb9c4dc4 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:26.850689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9e4fb-6b79-4ba5-a7b5-48c1eb9c4dc4 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:26.867937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:26.885789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:26.886657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:26.886939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:26.887213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] PATH_INFO: `/v3/users/a58ecc633a00404f9dd1d436b9f8b78e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:26.899869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] RBAC: Authorizing `identity:get_user(user_id=a58ecc633a00404f9dd1d436b9f8b78e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:26.901316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:26.902954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 565/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:26 2022] GET /identity/v3/users/a58ecc633a00404f9dd1d436b9f8b78e => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:26.908735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:26.955126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:27.009624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf30c-06e9-4f08-baaf-c0446793a3d7 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:27.041377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:27.042016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:27.042296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:27.042572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:27.106246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:27.107696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:27.160815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:27.214678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 550/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:27.220570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:27.318012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bb9b9-1f14-41c9-aebe-5ae4245a6579 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:27.351358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a1621-acdc-4eea-bbb2-12fc98b6c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:27.352217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a1621-acdc-4eea-bbb2-12fc98b6c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:27.352505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a1621-acdc-4eea-bbb2-12fc98b6c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:27.352814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a1621-acdc-4eea-bbb2-12fc98b6c1c3 None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:27.353995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a1621-acdc-4eea-bbb2-12fc98b6c1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=4d2c3d8e4ef64b6e859233793dd0341c)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:27.355417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a1621-acdc-4eea-bbb2-12fc98b6c1c3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:27.357112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 566/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:27 2022] GET /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:27.363210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:27.459292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a6d9b-c833-480f-9603-991d13752f52 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:27.492135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887ee38-5962-4850-b1d4-d0362fd4d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:27.492802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ee38-5962-4850-b1d4-d0362fd4d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:27.493083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ee38-5962-4850-b1d4-d0362fd4d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:27.493356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ee38-5962-4850-b1d4-d0362fd4d3b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:27.494174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887ee38-5962-4850-b1d4-d0362fd4d3b7 None admin] RBAC: Adding query filter params (role.id=8888db000f97433e8f047879704f3916, scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c, user.id=a58ecc633a00404f9dd1d436b9f8b78e) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:27.494484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887ee38-5962-4850-b1d4-d0362fd4d3b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:27.495920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887ee38-5962-4850-b1d4-d0362fd4d3b7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:27.501160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 551/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:27 2022] GET /identity/v3/role_assignments?user.id=a58ecc633a00404f9dd1d436b9f8b78e&scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c&role.id=8888db000f97433e8f047879704f3916 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:29.687542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057907e-bfd0-4ef0-bcb7-db97732529b4 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:29.688060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057907e-bfd0-4ef0-bcb7-db97732529b4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:29.688060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057907e-bfd0-4ef0-bcb7-db97732529b4 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:29.689395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 567/1118] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:29.695044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbbd70-0c40-4214-b567-487e1a0ffa78 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:29.695452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbbd70-0c40-4214-b567-487e1a0ffa78 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:29.695604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbbd70-0c40-4214-b567-487e1a0ffa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:29.711938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-abfbbd70-0c40-4214-b567-487e1a0ffa78 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:29.713141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-abfbbd70-0c40-4214-b567-487e1a0ffa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:29.715041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:29.778062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 552/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:29.800377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057907e-bfd0-4ef0-bcb7-db97732529b4 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:29.854496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:29.912492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057907e-bfd0-4ef0-bcb7-db97732529b4 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:29.946587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:29.947597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:29.947881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:29.948247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] PATH_INFO: `/v3/roles/8888db000f97433e8f047879704f3916` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:29.950450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] RBAC: Authorizing `identity:get_role(role_id=8888db000f97433e8f047879704f3916)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:29.951824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:29.953229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 568/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:29 2022] GET /identity/v3/roles/8888db000f97433e8f047879704f3916 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:29.959125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbbd70-0c40-4214-b567-487e1a0ffa78 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:30.055179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbbd70-0c40-4214-b567-487e1a0ffa78 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:30.087294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:30.088159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:30.088441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:30.088744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] PATH_INFO: `/v3/users/a58ecc633a00404f9dd1d436b9f8b78e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:30.089921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] RBAC: Authorizing `identity:get_user(user_id=a58ecc633a00404f9dd1d436b9f8b78e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:30.091349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:30.092960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 553/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:29 2022] GET /identity/v3/users/a58ecc633a00404f9dd1d436b9f8b78e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:30.098605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:30.198586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e5f7-a660-4a1d-a563-d76ffec9d5c0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:30.214517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:30.235836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9973f-2fcd-479c-ba4f-dbcadf42aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:30.236729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9973f-2fcd-479c-ba4f-dbcadf42aca4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:30.237017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9973f-2fcd-479c-ba4f-dbcadf42aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:30.237297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9973f-2fcd-479c-ba4f-dbcadf42aca4 None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:30.238476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9973f-2fcd-479c-ba4f-dbcadf42aca4 None admin] RBAC: Authorizing `identity:get_project(project_id=4d2c3d8e4ef64b6e859233793dd0341c)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:30.240573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9973f-2fcd-479c-ba4f-dbcadf42aca4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:30.242276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 569/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:30 2022] GET /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:30.248112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:30.256724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:30.344000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fda74-f00b-4a2a-b6ea-c2dac068dc46 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:30.377368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780b8ed-c8f9-41ab-9d56-c00d41f38abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:30.378253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780b8ed-c8f9-41ab-9d56-c00d41f38abc None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:30.378542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780b8ed-c8f9-41ab-9d56-c00d41f38abc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:30.378827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780b8ed-c8f9-41ab-9d56-c00d41f38abc None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c/users/a58ecc633a00404f9dd1d436b9f8b78e/roles/8888db000f97433e8f047879704f3916` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:30.381087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780b8ed-c8f9-41ab-9d56-c00d41f38abc None admin] RBAC: Authorizing `identity:create_grant(project_id=4d2c3d8e4ef64b6e859233793dd0341c, user_id=a58ecc633a00404f9dd1d436b9f8b78e, role_id=8888db000f97433e8f047879704f3916)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:30.382533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780b8ed-c8f9-41ab-9d56-c00d41f38abc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:30.395391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 554/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:43:30 2022] PUT /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c/users/a58ecc633a00404f9dd1d436b9f8b78e/roles/8888db000f97433e8f047879704f3916 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:43:32.579430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bd3b-d166-42d4-b495-0d05f8ac8d4d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:32.579929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bd3b-d166-42d4-b495-0d05f8ac8d4d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:32.579929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bd3b-d166-42d4-b495-0d05f8ac8d4d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:32.581322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 570/1124] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:32.586476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16694c1-d9d3-4039-a48e-380762e53c04 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:32.586867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16694c1-d9d3-4039-a48e-380762e53c04 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:32.587045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16694c1-d9d3-4039-a48e-380762e53c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:32.604015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b16694c1-d9d3-4039-a48e-380762e53c04 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:32.605230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b16694c1-d9d3-4039-a48e-380762e53c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:32.665055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:32.673517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 555/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:32.696619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635bd3b-d166-42d4-b495-0d05f8ac8d4d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:32.794138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635bd3b-d166-42d4-b495-0d05f8ac8d4d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:32.827523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:32.828355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:32.828665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:32.828944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] PATH_INFO: `/v3/roles/8888db000f97433e8f047879704f3916` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:32.830458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] RBAC: Authorizing `identity:get_role(role_id=8888db000f97433e8f047879704f3916)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:32.831774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:32.833172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 571/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:32 2022] GET /identity/v3/roles/8888db000f97433e8f047879704f3916 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:32.838693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16694c1-d9d3-4039-a48e-380762e53c04 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:32.934289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16694c1-d9d3-4039-a48e-380762e53c04 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:32.967071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:32.967942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:32.968229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:32.968509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] PATH_INFO: `/v3/users/a58ecc633a00404f9dd1d436b9f8b78e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:32.969721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] RBAC: Authorizing `identity:get_user(user_id=a58ecc633a00404f9dd1d436b9f8b78e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:32.971156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:32.972790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 556/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:32 2022] GET /identity/v3/users/a58ecc633a00404f9dd1d436b9f8b78e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:32.978478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:33.026521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:33.076445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087aba2-7167-43e4-9d82-bf5cbce68ba8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:33.109634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:33.110215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:33.110501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:33.110779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:33.176239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:33.178360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:33.224364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:33.274210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 572/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:33.280003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:33.341327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:33.378759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30533-1d9b-4048-a230-97a2598ff6e1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:33.412296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f04a6-096d-48af-8767-8078b7362f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:33.413171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f04a6-096d-48af-8767-8078b7362f3f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:33.413457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f04a6-096d-48af-8767-8078b7362f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:33.413737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f04a6-096d-48af-8767-8078b7362f3f None admin] PATH_INFO: `/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:33.414919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f04a6-096d-48af-8767-8078b7362f3f None admin] RBAC: Authorizing `identity:get_project(project_id=4d2c3d8e4ef64b6e859233793dd0341c)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:33.416364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f04a6-096d-48af-8767-8078b7362f3f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:33.418062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 557/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:33 2022] GET /identity/v3/projects/4d2c3d8e4ef64b6e859233793dd0341c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:33.424477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:33.518987 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb16e71-8958-4f9d-9dfa-3d1f745c9741 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:33.553466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6cbba-2f73-49ff-96b6-4aa2d17c4468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:33.554100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6cbba-2f73-49ff-96b6-4aa2d17c4468 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:33.554382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6cbba-2f73-49ff-96b6-4aa2d17c4468 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:33.554657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6cbba-2f73-49ff-96b6-4aa2d17c4468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:33.555472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6cbba-2f73-49ff-96b6-4aa2d17c4468 None admin] RBAC: Adding query filter params (role.id=8888db000f97433e8f047879704f3916, scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c, user.id=a58ecc633a00404f9dd1d436b9f8b78e) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:33.555783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6cbba-2f73-49ff-96b6-4aa2d17c4468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:33.557232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6cbba-2f73-49ff-96b6-4aa2d17c4468 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:33.562828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 573/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:33 2022] GET /identity/v3/role_assignments?user.id=a58ecc633a00404f9dd1d436b9f8b78e&scope.project.id=4d2c3d8e4ef64b6e859233793dd0341c&role.id=8888db000f97433e8f047879704f3916 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:35.785955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d5cde-0a38-485f-9a80-3c0af73fee74 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:35.787001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d5cde-0a38-485f-9a80-3c0af73fee74 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:35.787112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d5cde-0a38-485f-9a80-3c0af73fee74 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:35.788439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 558/1131] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:35.793611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d802-b1c0-47f5-9d01-b25a49491311 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:35.794005 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d802-b1c0-47f5-9d01-b25a49491311 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:35.794173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d802-b1c0-47f5-9d01-b25a49491311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:35.810763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4ff5d802-b1c0-47f5-9d01-b25a49491311 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:35.811940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4ff5d802-b1c0-47f5-9d01-b25a49491311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:35.819056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:35.876836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 574/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:35.900346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d5cde-0a38-485f-9a80-3c0af73fee74 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:36.002283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d5cde-0a38-485f-9a80-3c0af73fee74 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:36.030744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:36.036890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c850a-da62-4aa2-abe7-4c85b72b3fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:36.037624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c850a-da62-4aa2-abe7-4c85b72b3fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:36.037907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c850a-da62-4aa2-abe7-4c85b72b3fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:36.038183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c850a-da62-4aa2-abe7-4c85b72b3fe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:36.039349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c850a-da62-4aa2-abe7-4c85b72b3fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:36.040830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c850a-da62-4aa2-abe7-4c85b72b3fe1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:36.042435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 559/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:36.048495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5d802-b1c0-47f5-9d01-b25a49491311 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:36.143681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5d802-b1c0-47f5-9d01-b25a49491311 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:36.177308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb9d8a-bfa8-4324-9c2d-e245cbe179b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:36.177957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9d8a-bfa8-4324-9c2d-e245cbe179b3 None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:36.178243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9d8a-bfa8-4324-9c2d-e245cbe179b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:36.178521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9d8a-bfa8-4324-9c2d-e245cbe179b3 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:36.179219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb9d8a-bfa8-4324-9c2d-e245cbe179b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:36.180652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb9d8a-bfa8-4324-9c2d-e245cbe179b3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:36.193204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:36.205252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 575/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:43:36 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:43:38.437933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb9a1-61fa-44da-853f-39c638eb92c6 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:38.438487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb9a1-61fa-44da-853f-39c638eb92c6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:38.438487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb9a1-61fa-44da-853f-39c638eb92c6 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:38.439855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 560/1135] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:38.445163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501f64-7af2-40dc-a563-46465a84af12 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:38.445559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501f64-7af2-40dc-a563-46465a84af12 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:38.445726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501f64-7af2-40dc-a563-46465a84af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:38.462292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-58501f64-7af2-40dc-a563-46465a84af12 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:38.463416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-58501f64-7af2-40dc-a563-46465a84af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:38.528362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 576/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:38.553620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb9a1-61fa-44da-853f-39c638eb92c6 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:38.653820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb9a1-61fa-44da-853f-39c638eb92c6 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:38.687364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b8bd0-5c7b-4876-a776-9e3d25b4c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:38.688152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b8bd0-5c7b-4876-a776-9e3d25b4c3af None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:38.688436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b8bd0-5c7b-4876-a776-9e3d25b4c3af None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:38.688742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b8bd0-5c7b-4876-a776-9e3d25b4c3af None admin] PATH_INFO: `/v3/domains/default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:38.689914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b8bd0-5c7b-4876-a776-9e3d25b4c3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:38.691358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b8bd0-5c7b-4876-a776-9e3d25b4c3af None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:38.693018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 561/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:43:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:38.698706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58501f64-7af2-40dc-a563-46465a84af12 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:38.804522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58501f64-7af2-40dc-a563-46465a84af12 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:38.827017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:38.839196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6bfbe-6c42-4754-b427-764f875ab0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:38.839860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6bfbe-6c42-4754-b427-764f875ab0ab None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:38.840148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6bfbe-6c42-4754-b427-764f875ab0ab None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:38.840430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6bfbe-6c42-4754-b427-764f875ab0ab None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:38.841168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6bfbe-6c42-4754-b427-764f875ab0ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:38.842597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6bfbe-6c42-4754-b427-764f875ab0ab None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:38.862214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 577/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:43:38 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:43:41.094495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5842-f7ef-4a9c-bc9c-200657562942 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:41.095019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5842-f7ef-4a9c-bc9c-200657562942 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:41.095135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5842-f7ef-4a9c-bc9c-200657562942 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:41.096397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 562/1139] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:41.102174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fa029-0b99-46d5-b141-7bd98f74263e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:41.102573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fa029-0b99-46d5-b141-7bd98f74263e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:41.102734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fa029-0b99-46d5-b141-7bd98f74263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:41.119088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-3b6fa029-0b99-46d5-b141-7bd98f74263e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:41.120267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3b6fa029-0b99-46d5-b141-7bd98f74263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:41.184882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 578/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:43:41.208402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5842-f7ef-4a9c-bc9c-200657562942 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:41.274246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:41.307823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5842-f7ef-4a9c-bc9c-200657562942 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:41.341151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:41.341938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:41.342225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:41.342505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:41.352385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:41.360006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:41.361143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:41.362194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 563/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:41.367246 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fa029-0b99-46d5-b141-7bd98f74263e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:41.463827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fa029-0b99-46d5-b141-7bd98f74263e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:41.474096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:41.497566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:41.498224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:41.498509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:41.498787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:41.499524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:41.499830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:41.501239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:41.509520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 579/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:41.515117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:41.611797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cbf3e-6105-43ff-8649-db2048773d1b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:41.636805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:41.644778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e627-8de1-4176-9838-398b539b742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:41.646203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e627-8de1-4176-9838-398b539b742d None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:41.646484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e627-8de1-4176-9838-398b539b742d None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:41.646761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e627-8de1-4176-9838-398b539b742d None admin] PATH_INFO: `/v3/users/f2b82a9a871f4b3088b6103375b6d65b` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:41.659549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044e627-8de1-4176-9838-398b539b742d None admin] RBAC: Authorizing `identity:get_user(user_id=f2b82a9a871f4b3088b6103375b6d65b)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:41.661056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044e627-8de1-4176-9838-398b539b742d None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:41.662679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 564/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:41 2022] GET /identity/v3/users/f2b82a9a871f4b3088b6103375b6d65b => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:41.668233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:41.764624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6db68-dc15-4077-b144-3eb51d33ba97 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:41.796413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:41.797071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:41.797358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:41.797634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:41.837763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:41.864516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:41.865890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:41.966050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 580/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:41.972389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e627-8de1-4176-9838-398b539b742d None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:42.074655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e627-8de1-4176-9838-398b539b742d None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:42.108311 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476144c-622c-466e-bc0b-8160a50ae696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:42.109218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476144c-622c-466e-bc0b-8160a50ae696 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:42.109509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476144c-622c-466e-bc0b-8160a50ae696 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:42.109789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476144c-622c-466e-bc0b-8160a50ae696 None admin] PATH_INFO: `/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:42.110970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476144c-622c-466e-bc0b-8160a50ae696 None admin] RBAC: Authorizing `identity:get_project(project_id=c89bd5d0e613458ea44ea5eecbdbf637)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:42.112413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476144c-622c-466e-bc0b-8160a50ae696 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:42.114126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 565/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:41 2022] GET /identity/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:42.120264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:42.189139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:42.218944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d612c-b265-42f8-83fc-5ed6e776806f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:42.252440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a8af-d319-4886-bd63-e36bfc48a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:42.253118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a8af-d319-4886-bd63-e36bfc48a992 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:42.253409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a8af-d319-4886-bd63-e36bfc48a992 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:42.253695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a8af-d319-4886-bd63-e36bfc48a992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:42.254524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a8af-d319-4886-bd63-e36bfc48a992 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=c89bd5d0e613458ea44ea5eecbdbf637, user.id=f2b82a9a871f4b3088b6103375b6d65b) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:42.255360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a8af-d319-4886-bd63-e36bfc48a992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:42.256815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a8af-d319-4886-bd63-e36bfc48a992 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:42.262127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 581/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:42 2022] GET /identity/v3/role_assignments?user.id=f2b82a9a871f4b3088b6103375b6d65b&scope.project.id=c89bd5d0e613458ea44ea5eecbdbf637&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:44.478555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38dbb5-3988-429e-a167-296ed66c321b None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:44.479064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38dbb5-3988-429e-a167-296ed66c321b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:44.479064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38dbb5-3988-429e-a167-296ed66c321b None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:44.480379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 566/1147] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:44.485471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091910c-ac6d-45f0-8e25-4d2199c38465 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:44.485887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091910c-ac6d-45f0-8e25-4d2199c38465 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:44.486036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091910c-ac6d-45f0-8e25-4d2199c38465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:44.503054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c091910c-ac6d-45f0-8e25-4d2199c38465 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:44.504227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c091910c-ac6d-45f0-8e25-4d2199c38465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:44.568166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 582/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:44.590513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38dbb5-3988-429e-a167-296ed66c321b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:44.646420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:44.691642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38dbb5-3988-429e-a167-296ed66c321b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:44.724318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:44.725119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:44.725400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:44.725673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:44.735510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:44.743123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:44.744219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:44.745389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 567/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:44.750164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091910c-ac6d-45f0-8e25-4d2199c38465 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:44.813348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:44.847506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091910c-ac6d-45f0-8e25-4d2199c38465 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:44.880564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:44.881238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:44.881519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:44.881795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:44.882526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:44.882832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:44.884195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:44.891859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 583/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:44.898018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:44.996088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b93e-3669-4143-b8ab-5b8f597bf891 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:45.010444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:45.030066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:45.030929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:45.031211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:45.031487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] PATH_INFO: `/v3/users/f2b82a9a871f4b3088b6103375b6d65b` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:45.032697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] RBAC: Authorizing `identity:get_user(user_id=f2b82a9a871f4b3088b6103375b6d65b)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:45.034141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:45.035748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 568/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:44 2022] GET /identity/v3/users/f2b82a9a871f4b3088b6103375b6d65b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:45.041819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:45.139183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b4052-585e-4e02-9c82-28464d354c47 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:45.166046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:45.175253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0b646-aed1-4bb3-b20d-018aab7380b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:45.176135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0b646-aed1-4bb3-b20d-018aab7380b0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:45.176421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0b646-aed1-4bb3-b20d-018aab7380b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:45.177268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0b646-aed1-4bb3-b20d-018aab7380b0 None admin] PATH_INFO: `/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:45.178471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0b646-aed1-4bb3-b20d-018aab7380b0 None admin] RBAC: Authorizing `identity:get_project(project_id=c89bd5d0e613458ea44ea5eecbdbf637)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:45.179913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0b646-aed1-4bb3-b20d-018aab7380b0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:45.181665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 584/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:45 2022] GET /identity/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:45.187566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:45.288363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48ba7-13f8-4260-892e-439f685da36a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:45.321740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ffae1-4769-4f0b-bef1-6a7bf798fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:45.322631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ffae1-4769-4f0b-bef1-6a7bf798fedd None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:45.322918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ffae1-4769-4f0b-bef1-6a7bf798fedd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:45.323195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ffae1-4769-4f0b-bef1-6a7bf798fedd None admin] PATH_INFO: `/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637/users/f2b82a9a871f4b3088b6103375b6d65b/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:45.325206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ffae1-4769-4f0b-bef1-6a7bf798fedd None admin] RBAC: Authorizing `identity:create_grant(project_id=c89bd5d0e613458ea44ea5eecbdbf637, user_id=f2b82a9a871f4b3088b6103375b6d65b, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:45.326651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ffae1-4769-4f0b-bef1-6a7bf798fedd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:45.340871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 569/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:43:45 2022] PUT /identity/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637/users/f2b82a9a871f4b3088b6103375b6d65b/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:43:47.519790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65918e5-ca50-4273-93e6-b65460277b00 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:47.520338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65918e5-ca50-4273-93e6-b65460277b00 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:47.520338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65918e5-ca50-4273-93e6-b65460277b00 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:47.522215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 585/1154] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:47.527512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae585e7-d935-4d4e-bf4e-4c214c66a991 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:47.527960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae585e7-d935-4d4e-bf4e-4c214c66a991 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:47.528063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae585e7-d935-4d4e-bf4e-4c214c66a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:47.544414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5ae585e7-d935-4d4e-bf4e-4c214c66a991 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:47.545900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5ae585e7-d935-4d4e-bf4e-4c214c66a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:47.579517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:47.610878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 570/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:47.634027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65918e5-ca50-4273-93e6-b65460277b00 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:47.732316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65918e5-ca50-4273-93e6-b65460277b00 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:47.764878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:47.765660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:47.765945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:47.766223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:47.776476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:43:47.784071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:47.785261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:43:47.786408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 586/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:47.793237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae585e7-d935-4d4e-bf4e-4c214c66a991 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:47.889010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae585e7-d935-4d4e-bf4e-4c214c66a991 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:47.922722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:47.923382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:47.923665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:47.923942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:47.924706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:47.925017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:47.926424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:47.934274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 571/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:47.940145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:47.994971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:48.038618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b4982-6bd3-4c04-a451-69192fcf9a7f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:48.071550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:48.072420 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:48.072740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:48.073026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] PATH_INFO: `/v3/users/f2b82a9a871f4b3088b6103375b6d65b` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:48.074217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] RBAC: Authorizing `identity:get_user(user_id=f2b82a9a871f4b3088b6103375b6d65b)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:48.075651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:48.077333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 587/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:43:47 2022] GET /identity/v3/users/f2b82a9a871f4b3088b6103375b6d65b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:48.083508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:48.120150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:48.185847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7891b8-b1ac-44fe-ad00-5392f91e2685 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:48.224836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:48.225508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:48.225788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:48.226065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:48.291342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:48.292778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:48.324399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:48.388509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 572/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:48.394364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:48.489599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b627-ed59-4f44-9744-8748d63d049a None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:48.514996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:48.525884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a81cf-30a5-4a43-ba8a-ada5d7fcf446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:48.526730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a81cf-30a5-4a43-ba8a-ada5d7fcf446 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:48.527011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a81cf-30a5-4a43-ba8a-ada5d7fcf446 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:48.527287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a81cf-30a5-4a43-ba8a-ada5d7fcf446 None admin] PATH_INFO: `/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:48.528455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a81cf-30a5-4a43-ba8a-ada5d7fcf446 None admin] RBAC: Authorizing `identity:get_project(project_id=c89bd5d0e613458ea44ea5eecbdbf637)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:48.529898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a81cf-30a5-4a43-ba8a-ada5d7fcf446 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:48.531555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 588/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:43:48 2022] GET /identity/v3/projects/c89bd5d0e613458ea44ea5eecbdbf637 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:48.537588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:48.633239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede03492-7bef-4958-8a67-f23f10a972b3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:48.665088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08cbb1-a542-4b64-8e1f-ce409bc01ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:48.665728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08cbb1-a542-4b64-8e1f-ce409bc01ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:48.666012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08cbb1-a542-4b64-8e1f-ce409bc01ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:48.666290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08cbb1-a542-4b64-8e1f-ce409bc01ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:48.667107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08cbb1-a542-4b64-8e1f-ce409bc01ff7 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=c89bd5d0e613458ea44ea5eecbdbf637, user.id=f2b82a9a871f4b3088b6103375b6d65b) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:48.667418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08cbb1-a542-4b64-8e1f-ce409bc01ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:48.668866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08cbb1-a542-4b64-8e1f-ce409bc01ff7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:48.670886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:48.675859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 573/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:43:48 2022] GET /identity/v3/role_assignments?user.id=f2b82a9a871f4b3088b6103375b6d65b&scope.project.id=c89bd5d0e613458ea44ea5eecbdbf637&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:50.972867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfec1-c4e0-462a-8dc6-f12cc48fc980 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:50.973414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfec1-c4e0-462a-8dc6-f12cc48fc980 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:50.973515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfec1-c4e0-462a-8dc6-f12cc48fc980 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:50.974836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 589/1162] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:50.980131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348cab-f660-4594-a08f-c79dd46105e6 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:50.980565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348cab-f660-4594-a08f-c79dd46105e6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:50.980726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348cab-f660-4594-a08f-c79dd46105e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:50.997697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9a348cab-f660-4594-a08f-c79dd46105e6 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:50.998888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9a348cab-f660-4594-a08f-c79dd46105e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:51.064600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 574/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:51.086205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cfec1-c4e0-462a-8dc6-f12cc48fc980 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:51.185450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cfec1-c4e0-462a-8dc6-f12cc48fc980 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:51.218416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:51.219059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:51.219344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:51.219622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:51.276400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:51.286278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:51.287718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:51.382492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 590/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:43:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:43:51.388420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a348cab-f660-4594-a08f-c79dd46105e6 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:51.485056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a348cab-f660-4594-a08f-c79dd46105e6 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:51.510220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:51.518357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47498ea8-7412-4d77-85bb-444d2467040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:51.519155 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498ea8-7412-4d77-85bb-444d2467040a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:51.519446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498ea8-7412-4d77-85bb-444d2467040a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:51.519728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498ea8-7412-4d77-85bb-444d2467040a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:51.526985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47498ea8-7412-4d77-85bb-444d2467040a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:51.528384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47498ea8-7412-4d77-85bb-444d2467040a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-47498ea8-7412-4d77-85bb-444d2467040a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:43:51.543243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:43:51.544290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:43:51.545552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 575/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:43:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:43:51.550568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:51.636951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:51.646203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b7a2-6548-4397-8a5d-2ae57d11a7b1 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:51.679147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9a26d-218c-4dc9-b847-f1320e4ace26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:51.679802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a26d-218c-4dc9-b847-f1320e4ace26 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:51.680088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a26d-218c-4dc9-b847-f1320e4ace26 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:51.680368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a26d-218c-4dc9-b847-f1320e4ace26 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:51.681113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9a26d-218c-4dc9-b847-f1320e4ace26 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:43:51.681425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9a26d-218c-4dc9-b847-f1320e4ace26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:51.682790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9a26d-218c-4dc9-b847-f1320e4ace26 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:51.689712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 591/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 18 14:43:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:53.865030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6363a-8e9e-45f3-b6a6-cfc0debe13df None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:53.865556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6363a-8e9e-45f3-b6a6-cfc0debe13df None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:53.865556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6363a-8e9e-45f3-b6a6-cfc0debe13df None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:53.866943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 576/1167] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:53.872112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462857b-6106-4773-b01a-6cd5d465c9c8 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:53.872537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462857b-6106-4773-b01a-6cd5d465c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:53.872705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462857b-6106-4773-b01a-6cd5d465c9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:53.889937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0462857b-6106-4773-b01a-6cd5d465c9c8 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:53.891127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0462857b-6106-4773-b01a-6cd5d465c9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:53.963546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 592/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:53.986519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6363a-8e9e-45f3-b6a6-cfc0debe13df None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:54.086838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6363a-8e9e-45f3-b6a6-cfc0debe13df None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:54.119629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276e36-768a-413d-b15e-4aaf1acc85ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:54.120217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276e36-768a-413d-b15e-4aaf1acc85ff None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:54.120505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276e36-768a-413d-b15e-4aaf1acc85ff None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:54.120811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276e36-768a-413d-b15e-4aaf1acc85ff None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:54.121545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7276e36-768a-413d-b15e-4aaf1acc85ff None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:54.122939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7276e36-768a-413d-b15e-4aaf1acc85ff None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:54.138018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 577/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Wed May 18 14:43:53 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:43:56.346316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654dfc-d277-480e-bb91-cd8fe82a20c1 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:56.346856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654dfc-d277-480e-bb91-cd8fe82a20c1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:56.346957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654dfc-d277-480e-bb91-cd8fe82a20c1 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:56.348767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 593/1170] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:43:56.354141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6748db-4bec-4dd3-95ec-900d71881535 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:56.354512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6748db-4bec-4dd3-95ec-900d71881535 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:56.354718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6748db-4bec-4dd3-95ec-900d71881535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:56.372439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-0d6748db-4bec-4dd3-95ec-900d71881535 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:56.373671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0d6748db-4bec-4dd3-95ec-900d71881535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:56.415284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:56.439784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 578/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:56.463912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654dfc-d277-480e-bb91-cd8fe82a20c1 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:56.547729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:56.564089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654dfc-d277-480e-bb91-cd8fe82a20c1 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:56.596335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f307a7-f13f-40ae-b056-f8532353a8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:56.597220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f307a7-f13f-40ae-b056-f8532353a8ad None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:56.597515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f307a7-f13f-40ae-b056-f8532353a8ad None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:56.597798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f307a7-f13f-40ae-b056-f8532353a8ad None admin] PATH_INFO: `/v3/domains/6b1a5a76d56d4702892e1bc03b12e312` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:56.608436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f307a7-f13f-40ae-b056-f8532353a8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=6b1a5a76d56d4702892e1bc03b12e312)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:56.609905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f307a7-f13f-40ae-b056-f8532353a8ad None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:56.611528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 594/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Wed May 18 14:43:56 2022] GET /identity/v3/domains/6b1a5a76d56d4702892e1bc03b12e312 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:56.617907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6748db-4bec-4dd3-95ec-900d71881535 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:56.714199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6748db-4bec-4dd3-95ec-900d71881535 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:56.746813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9407e-a44a-4e4c-8302-3a4d406eb64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:56.747463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9407e-a44a-4e4c-8302-3a4d406eb64c None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:56.747748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9407e-a44a-4e4c-8302-3a4d406eb64c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:56.748028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9407e-a44a-4e4c-8302-3a4d406eb64c None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:56.748770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9407e-a44a-4e4c-8302-3a4d406eb64c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:56.750214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9407e-a44a-4e4c-8302-3a4d406eb64c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:56.775391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 579/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:43:56 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:43:59.009303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434e12-cb16-4434-a705-008eafc0fddc None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:59.009848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434e12-cb16-4434-a705-008eafc0fddc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:59.009848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434e12-cb16-4434-a705-008eafc0fddc None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:59.011238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 595/1174] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:43:59.016500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d560-e0a0-43bd-bb1a-d07cb5743c1f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:59.016915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d560-e0a0-43bd-bb1a-d07cb5743c1f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:59.017111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d560-e0a0-43bd-bb1a-d07cb5743c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:59.033520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-6021d560-e0a0-43bd-bb1a-d07cb5743c1f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:43:59.034701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6021d560-e0a0-43bd-bb1a-d07cb5743c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:43:59.058055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:43:59.102582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 580/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:43:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:43:59.126706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01434e12-cb16-4434-a705-008eafc0fddc None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:59.226692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01434e12-cb16-4434-a705-008eafc0fddc None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:59.260454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe55d7-7ba4-4b10-b286-dbb6a70444be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:59.261293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe55d7-7ba4-4b10-b286-dbb6a70444be None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:59.261576 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe55d7-7ba4-4b10-b286-dbb6a70444be None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:59.261852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe55d7-7ba4-4b10-b286-dbb6a70444be None admin] PATH_INFO: `/v3/domains/6b1a5a76d56d4702892e1bc03b12e312` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:59.263049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe55d7-7ba4-4b10-b286-dbb6a70444be None admin] RBAC: Authorizing `identity:get_domain(domain_id=6b1a5a76d56d4702892e1bc03b12e312)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:59.264474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe55d7-7ba4-4b10-b286-dbb6a70444be None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:59.266119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 596/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Wed May 18 14:43:59 2022] GET /identity/v3/domains/6b1a5a76d56d4702892e1bc03b12e312 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:43:59.272763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d560-e0a0-43bd-bb1a-d07cb5743c1f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:43:59.369001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d560-e0a0-43bd-bb1a-d07cb5743c1f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:43:59.402642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb196e-6e1c-4ff8-bb82-44f9fa0e6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:43:59.403311 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb196e-6e1c-4ff8-bb82-44f9fa0e6052 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:43:59.403595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb196e-6e1c-4ff8-bb82-44f9fa0e6052 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:43:59.403875 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb196e-6e1c-4ff8-bb82-44f9fa0e6052 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:43:59.404597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb196e-6e1c-4ff8-bb82-44f9fa0e6052 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:43:59.406046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb196e-6e1c-4ff8-bb82-44f9fa0e6052 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:43:59.425822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 581/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:43:59 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:44:01.681359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f0fa-05f2-4b83-96b2-1b09d215e204 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:01.681875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f0fa-05f2-4b83-96b2-1b09d215e204 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:01.681875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f0fa-05f2-4b83-96b2-1b09d215e204 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:01.683217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 597/1178] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:44:01.688544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17ec2-5a79-45b7-87ca-94647d89322b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:01.688972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17ec2-5a79-45b7-87ca-94647d89322b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:01.689151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17ec2-5a79-45b7-87ca-94647d89322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:01.706001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ddd17ec2-5a79-45b7-87ca-94647d89322b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:44:01.707173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ddd17ec2-5a79-45b7-87ca-94647d89322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:44:01.718194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:01.773832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 582/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:44:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:44:01.797120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f0fa-05f2-4b83-96b2-1b09d215e204 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:01.812929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:01.898901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f0fa-05f2-4b83-96b2-1b09d215e204 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:01.931507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:01.932231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:01.932514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:01.932830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:01.943522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:44:01.951092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:44:01.952275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:44:01.953206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 598/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:44:01.958442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17ec2-5a79-45b7-87ca-94647d89322b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:02.054139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17ec2-5a79-45b7-87ca-94647d89322b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:02.087417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:02.088077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:02.088363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:02.088673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:02.089416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:44:02.089727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:02.091125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:02.098999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 583/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:02.104474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:02.178925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:02.203955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58763-0621-497f-b93a-de231d9737f4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:02.236926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:02.237799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:02.238085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:02.238362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] PATH_INFO: `/v3/users/826e5bb6786c491794eb34958708f738` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:02.251595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] RBAC: Authorizing `identity:get_user(user_id=826e5bb6786c491794eb34958708f738)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:02.253065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:02.255448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 599/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:44:02 2022] GET /identity/v3/users/826e5bb6786c491794eb34958708f738 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:02.261707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:02.273745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:02.359140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9ee6-0d75-4beb-946c-3abef6489ac7 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:02.391356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:02.391997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:02.392280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:02.392558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:02.457011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:02.458440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:02.467572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:02.554235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 584/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:44:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:44:02.560043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:02.655479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4a7b6-af01-4d6f-8f8a-cbc68679f323 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:02.685899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:02.693329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79197bd-2ec4-4cf2-bc1a-6da3da4e008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:02.694558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79197bd-2ec4-4cf2-bc1a-6da3da4e008d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:02.694969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79197bd-2ec4-4cf2-bc1a-6da3da4e008d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:02.695260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79197bd-2ec4-4cf2-bc1a-6da3da4e008d None admin] PATH_INFO: `/v3/projects/fa253b7a378445ac90b2f046e99e97e4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:02.696457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79197bd-2ec4-4cf2-bc1a-6da3da4e008d None admin] RBAC: Authorizing `identity:get_project(project_id=fa253b7a378445ac90b2f046e99e97e4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:02.697933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79197bd-2ec4-4cf2-bc1a-6da3da4e008d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:02.699617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 600/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:44:02 2022] GET /identity/v3/projects/fa253b7a378445ac90b2f046e99e97e4 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:02.705555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:02.800378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bcf17-c537-4f53-aeb8-a3378d6fe554 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:02.809735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:02.834696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4992c25-c437-477d-817d-b16110996bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:02.835344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992c25-c437-477d-817d-b16110996bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:02.835627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992c25-c437-477d-817d-b16110996bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:02.835904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992c25-c437-477d-817d-b16110996bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:02.836753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4992c25-c437-477d-817d-b16110996bc9 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=fa253b7a378445ac90b2f046e99e97e4, user.id=826e5bb6786c491794eb34958708f738) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:44:02.837068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4992c25-c437-477d-817d-b16110996bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:02.838488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4992c25-c437-477d-817d-b16110996bc9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:02.843757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 585/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:44:02 2022] GET /identity/v3/role_assignments?user.id=826e5bb6786c491794eb34958708f738&scope.project.id=fa253b7a378445ac90b2f046e99e97e4&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:05.015913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1f53a-0b44-497f-9acf-b35e58b1a5f8 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:05.016470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1f53a-0b44-497f-9acf-b35e58b1a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:05.016470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1f53a-0b44-497f-9acf-b35e58b1a5f8 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:05.017866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 601/1186] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:44:05.023007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04eb1c-46ff-4d12-9b85-6457c93aba01 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:05.023375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04eb1c-46ff-4d12-9b85-6457c93aba01 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:05.023571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04eb1c-46ff-4d12-9b85-6457c93aba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:05.040103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ac04eb1c-46ff-4d12-9b85-6457c93aba01 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:44:05.041329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ac04eb1c-46ff-4d12-9b85-6457c93aba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:44:05.105392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 586/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:44:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:44:05.127743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1f53a-0b44-497f-9acf-b35e58b1a5f8 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:05.225125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1f53a-0b44-497f-9acf-b35e58b1a5f8 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:05.258325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:05.259103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:05.259386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:05.259671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:05.274612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:44:05.282368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:44:05.283519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:44:05.284602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 602/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:44:05.290127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04eb1c-46ff-4d12-9b85-6457c93aba01 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:05.384253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04eb1c-46ff-4d12-9b85-6457c93aba01 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:05.385750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:05.419154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:05.419823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:05.420375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:05.420687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:05.421432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:44:05.421746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:05.423128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:05.431608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 587/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:05.437675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:05.495278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:05.534462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bc539-610e-455d-a0dd-0db745a530e9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:05.567417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:05.568277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:05.568565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:05.568876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] PATH_INFO: `/v3/users/826e5bb6786c491794eb34958708f738` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:05.570056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] RBAC: Authorizing `identity:get_user(user_id=826e5bb6786c491794eb34958708f738)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:05.571479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:05.573124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 603/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:44:05 2022] GET /identity/v3/users/826e5bb6786c491794eb34958708f738 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:05.578663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:05.682933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a6a5-4fae-4ba4-90c8-3da07a947788 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:05.715461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d465e-a76b-498c-ac08-32480f383b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:05.716320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d465e-a76b-498c-ac08-32480f383b4f None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:05.716633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d465e-a76b-498c-ac08-32480f383b4f None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:05.716913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d465e-a76b-498c-ac08-32480f383b4f None admin] PATH_INFO: `/v3/projects/fa253b7a378445ac90b2f046e99e97e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:05.718085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d465e-a76b-498c-ac08-32480f383b4f None admin] RBAC: Authorizing `identity:get_project(project_id=fa253b7a378445ac90b2f046e99e97e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:05.719538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d465e-a76b-498c-ac08-32480f383b4f None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:05.721245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 588/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:44:05 2022] GET /identity/v3/projects/fa253b7a378445ac90b2f046e99e97e4 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:05.727680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:05.825878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2a0a-7730-4dd8-9b1a-47c250d306f3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:05.851438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:05.859354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f4d24-3ef0-4acc-b705-34c0b16b8fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:05.860243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4d24-3ef0-4acc-b705-34c0b16b8fb2 None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:05.860517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4d24-3ef0-4acc-b705-34c0b16b8fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:05.860825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4d24-3ef0-4acc-b705-34c0b16b8fb2 None admin] PATH_INFO: `/v3/projects/fa253b7a378445ac90b2f046e99e97e4/users/826e5bb6786c491794eb34958708f738/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:05.862784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f4d24-3ef0-4acc-b705-34c0b16b8fb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa253b7a378445ac90b2f046e99e97e4, user_id=826e5bb6786c491794eb34958708f738, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:05.864258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f4d24-3ef0-4acc-b705-34c0b16b8fb2 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:05.876516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 604/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:44:05 2022] PUT /identity/v3/projects/fa253b7a378445ac90b2f046e99e97e4/users/826e5bb6786c491794eb34958708f738/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:44:08.039303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383055b8-6d81-4a13-91cb-14b0ff5d37d3 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:08.039826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383055b8-6d81-4a13-91cb-14b0ff5d37d3 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:08.039939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383055b8-6d81-4a13-91cb-14b0ff5d37d3 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:08.041235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 589/1193] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:44:08.046589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a33e-e179-4b85-bc88-557c1c5b4d8a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:08.046980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a33e-e179-4b85-bc88-557c1c5b4d8a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:08.047148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a33e-e179-4b85-bc88-557c1c5b4d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:08.063918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8027a33e-e179-4b85-bc88-557c1c5b4d8a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:44:08.065116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8027a33e-e179-4b85-bc88-557c1c5b4d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:44:08.128627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 605/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:44:08.151383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383055b8-6d81-4a13-91cb-14b0ff5d37d3 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:08.182517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:08.250102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383055b8-6d81-4a13-91cb-14b0ff5d37d3 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:08.281807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:08.282583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:08.282866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:08.283141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:08.293865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:44:08.301657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:44:08.302754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:44:08.303651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 590/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:44:08.309059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027a33e-e179-4b85-bc88-557c1c5b4d8a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:08.404038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027a33e-e179-4b85-bc88-557c1c5b4d8a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:08.420602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:08.437742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:08.438400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:08.438684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:08.438964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:08.439695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:44:08.440000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:08.441383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:08.449910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 606/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:08.455780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:08.543456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:08.553308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31a37b-a748-44c3-bd2f-f3f039490925 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:08.587041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:08.587903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:08.588187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:08.588464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] PATH_INFO: `/v3/users/826e5bb6786c491794eb34958708f738` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:08.589681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] RBAC: Authorizing `identity:get_user(user_id=826e5bb6786c491794eb34958708f738)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:08.591119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:08.592739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 591/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 18 14:44:08 2022] GET /identity/v3/users/826e5bb6786c491794eb34958708f738 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:08.598270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:08.694400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc53150-7cbf-4b90-bb4d-da7396fbbec3 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:08.725614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:08.726237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:08.726518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:08.726791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:08.772410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:08.791082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:08.792508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:08.887089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 607/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:44:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:44:08.893044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:08.992240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ada1c2-cecf-4c0e-8dc4-fa3226a5b334 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:09.025791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8949d64-9041-432e-be3e-e2957fd041b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:09.026645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8949d64-9041-432e-be3e-e2957fd041b4 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:09.026925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8949d64-9041-432e-be3e-e2957fd041b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:09.027198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8949d64-9041-432e-be3e-e2957fd041b4 None admin] PATH_INFO: `/v3/projects/fa253b7a378445ac90b2f046e99e97e4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:09.028366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8949d64-9041-432e-be3e-e2957fd041b4 None admin] RBAC: Authorizing `identity:get_project(project_id=fa253b7a378445ac90b2f046e99e97e4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:09.029908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8949d64-9041-432e-be3e-e2957fd041b4 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:09.031590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 592/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 18 14:44:08 2022] GET /identity/v3/projects/fa253b7a378445ac90b2f046e99e97e4 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:09.038204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:44:09.115734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:09.134267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32995f25-2a74-4ca6-b9d4-5bcdab36a522 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:44:09.166943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a173a-2942-496d-ac7d-4a95200091bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:44:09.167524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a173a-2942-496d-ac7d-4a95200091bb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:44:09.167811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a173a-2942-496d-ac7d-4a95200091bb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:44:09.168092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a173a-2942-496d-ac7d-4a95200091bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:44:09.168947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a173a-2942-496d-ac7d-4a95200091bb None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=fa253b7a378445ac90b2f046e99e97e4, user.id=826e5bb6786c491794eb34958708f738) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:44:09.169264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a173a-2942-496d-ac7d-4a95200091bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:44:09.170944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a173a-2942-496d-ac7d-4a95200091bb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:44:09.177141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 608/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:44:09 2022] GET /identity/v3/role_assignments?user.id=826e5bb6786c491794eb34958708f738&scope.project.id=fa253b7a378445ac90b2f046e99e97e4&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:44:19.021513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=86 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:44:19.174016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=28 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:09.370266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9eba0-f9d0-4ae2-9ffe-a72e322378dd None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:09.370834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9eba0-f9d0-4ae2-9ffe-a72e322378dd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:09.370834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9eba0-f9d0-4ae2-9ffe-a72e322378dd None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:09.372187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 593/1201] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:09.377890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff21d4-ed9f-450d-80ab-886ed789a429 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:09.378411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff21d4-ed9f-450d-80ab-886ed789a429 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:09.378522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff21d4-ed9f-450d-80ab-886ed789a429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:09.403253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-69ff21d4-ed9f-450d-80ab-886ed789a429 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:09.405154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-69ff21d4-ed9f-450d-80ab-886ed789a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:09.506221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 609/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:09.531173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9eba0-f9d0-4ae2-9ffe-a72e322378dd None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:09.671640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9eba0-f9d0-4ae2-9ffe-a72e322378dd None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:09.715508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:09.716490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:09.716840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:09.717219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:09.730096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:09.731754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:09.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:09.762189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:09.763494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:09.763494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:09.763494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:09.763494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:09.763494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 594/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:09.763806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff21d4-ed9f-450d-80ab-886ed789a429 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:09.896929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff21d4-ed9f-450d-80ab-886ed789a429 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:09.933670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:09.941520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5745263-c353-478a-9e9f-7630597eef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:09.942370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5745263-c353-478a-9e9f-7630597eef7b None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:09.942655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5745263-c353-478a-9e9f-7630597eef7b None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:09.942931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5745263-c353-478a-9e9f-7630597eef7b None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:09.943668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5745263-c353-478a-9e9f-7630597eef7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:09.943978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5745263-c353-478a-9e9f-7630597eef7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:09.945528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5745263-c353-478a-9e9f-7630597eef7b None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:09.959722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 610/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:09.965746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:10.035076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:10.096106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09392-3acd-46fb-b425-1769b701d2c9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:10.137883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c51214-5362-48bf-8bdd-318c76b90df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:10.138598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51214-5362-48bf-8bdd-318c76b90df3 None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:10.138950 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51214-5362-48bf-8bdd-318c76b90df3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:10.139244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51214-5362-48bf-8bdd-318c76b90df3 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:10.140177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c51214-5362-48bf-8bdd-318c76b90df3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:10.145197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c51214-5362-48bf-8bdd-318c76b90df3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:10.171916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 595/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 18 14:45:09 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:45:12.776548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de8d6f-26c2-4aa1-89f0-c4efdddd4933 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:12.777230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de8d6f-26c2-4aa1-89f0-c4efdddd4933 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:12.777230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de8d6f-26c2-4aa1-89f0-c4efdddd4933 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:12.778496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 611/1206] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:12.783925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4fc1-4437-42b0-9eb6-ef73fb9305a1 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:12.784905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4fc1-4437-42b0-9eb6-ef73fb9305a1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:12.785076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4fc1-4437-42b0-9eb6-ef73fb9305a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:12.803001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-886f4fc1-4437-42b0-9eb6-ef73fb9305a1 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:12.804186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-886f4fc1-4437-42b0-9eb6-ef73fb9305a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:12.885947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 596/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:12.912390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de8d6f-26c2-4aa1-89f0-c4efdddd4933 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:13.043124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de8d6f-26c2-4aa1-89f0-c4efdddd4933 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:13.079026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:13.079859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:13.080248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:13.080537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:13.094546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:45:13.102946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:13.104183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:45:13.105447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:13.109674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 612/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:45:13.110713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4fc1-4437-42b0-9eb6-ef73fb9305a1 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:13.154347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:13.226679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4fc1-4437-42b0-9eb6-ef73fb9305a1 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:13.266829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:13.267499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:13.267786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:13.268066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:13.268878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:13.269191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:13.270567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:13.278830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 597/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:13.284567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:13.338332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:13.394509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368fa9-fea3-467a-8cea-91da0f6ee509 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:13.431945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:13.432782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:13.433066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:13.433340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:13.445318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:13.447088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:13.467711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:13.468928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:13.470094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:13.470094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:13.470094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:13.470094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:13.470094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 613/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:45:13.477087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:13.591607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:13.595028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65f29-3911-4222-95a5-deff325268db None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:13.635361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:13.636146 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:13.636480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:13.636794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:13.637641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:13.637957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:13.639489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:13.657037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 598/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:13.660322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:13.776177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a8313-c61c-448c-b624-8568405dc34e None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:13.778206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:13.819672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:13.820700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:13.821091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:13.821472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:13.829976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:13.832299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:45:13.851432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:13.852523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:13.853870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 614/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:13.860459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:13.976942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce12cc-178c-401a-b64d-7f9ebfccbfa3 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:14.017311 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:14.018224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:14.018336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:14.018660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:14.019589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:14.019902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:14.021475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:14.045246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 599/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 18 14:45:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:14.046954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:14.171019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181dfce-0ad4-40af-af25-c09e2304cdb7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:14.216672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:14.217404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:14.217730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:14.218057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:14.253343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:14.299373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:14.301277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:14.418180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 615/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:45:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:45:14.424410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:14.449574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:14.539698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d57ef-1bc3-4f65-bd55-f29fbbf9dd5a None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:14.577921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:14.578798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:14.579091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:14.579395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:14.591391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:14.593116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:14.615852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:14.617108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:14.618255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:14.618255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:14.618255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:14.618255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:14.622020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 600/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:14.623299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:14.700031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:14.741196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602436c4-ab10-4a60-85fb-5facb2da063e None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:14.780352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:14.782066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:14.782637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:14.783130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:14.784314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:14.784960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:14.786811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:14.802487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 616/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:14.808190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:14.882693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:14.919631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17c245-788d-4995-9b00-f6095e8dcd93 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:14.968705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:14.969618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:14.969943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:14.970441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:14.979180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:14.980858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:45:14.997939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:14.998997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:15.000091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 601/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:15.007913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:15.114263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212029e-db3b-46d4-9a2e-06dceda3b270 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:15.137690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:15.153578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222751f0-0f0b-4e06-9026-cb7ad71c3c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:15.154398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222751f0-0f0b-4e06-9026-cb7ad71c3c8a None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:15.154743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222751f0-0f0b-4e06-9026-cb7ad71c3c8a None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:15.155081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222751f0-0f0b-4e06-9026-cb7ad71c3c8a None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:15.155884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222751f0-0f0b-4e06-9026-cb7ad71c3c8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:15.156203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222751f0-0f0b-4e06-9026-cb7ad71c3c8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:15.157919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222751f0-0f0b-4e06-9026-cb7ad71c3c8a None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:15.176809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 617/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:15.178354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:15.300413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0460af-a9da-44fa-9ddc-0022a5520ed0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:15.339013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:15.346963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecd350-ab48-40ba-b335-59bef0db2287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:15.347973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecd350-ab48-40ba-b335-59bef0db2287 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:15.348472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecd350-ab48-40ba-b335-59bef0db2287 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:15.348842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecd350-ab48-40ba-b335-59bef0db2287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:15.349981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecd350-ab48-40ba-b335-59bef0db2287 None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=c316d4242edf4c82afd982127603827c) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:15.350301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecd350-ab48-40ba-b335-59bef0db2287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:15.352032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecd350-ab48-40ba-b335-59bef0db2287 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:15.368622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 602/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:45:15 2022] GET /identity/v3/role_assignments?user.id=c316d4242edf4c82afd982127603827c&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:17.785464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f2e1-8862-4973-bc61-de358fb8083b None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:17.786049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f2e1-8862-4973-bc61-de358fb8083b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:17.786049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f2e1-8862-4973-bc61-de358fb8083b None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:17.787384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 618/1220] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:17.792879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b12ca-f698-4a2f-a9fa-88e07e8f756d None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:17.793301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b12ca-f698-4a2f-a9fa-88e07e8f756d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:17.793447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b12ca-f698-4a2f-a9fa-88e07e8f756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:17.812805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-219b12ca-f698-4a2f-a9fa-88e07e8f756d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:17.814066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-219b12ca-f698-4a2f-a9fa-88e07e8f756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:17.886154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 603/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:17.910471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f2e1-8862-4973-bc61-de358fb8083b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:18.030415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f2e1-8862-4973-bc61-de358fb8083b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:18.072233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:18.073361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:18.073658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:18.074055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:18.087475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:45:18.095935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:18.097554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:18.098430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 619/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:45:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:18.104390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b12ca-f698-4a2f-a9fa-88e07e8f756d None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:18.232492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b12ca-f698-4a2f-a9fa-88e07e8f756d None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:18.257077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:18.268326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:18.269050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:18.269335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:18.269610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:18.270350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:18.270657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:18.272035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:18.280095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 604/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:45:18.286430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:18.332054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:18.397950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995bb8-1909-4f53-9a59-94670b69d4dd None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:18.436621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:18.437409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:18.437776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:18.438024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:18.453243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:18.455594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:18.478168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:18.479591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:18.480569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:18.480569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:18.480569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:18.480569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:18.480569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 620/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:18.485542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:18.601597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd018ad-c1e2-4504-807e-4478c8a4b5f0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:18.635822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:18.636501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:18.636838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:18.637122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:18.637840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:18.638152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:18.639531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:18.653366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 605/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:18.659676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:18.758343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:18.765816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc0eda-e707-4f4d-8de0-fa66827c1639 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:18.803114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:18.803997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:18.804310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:18.804650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:18.812556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:18.814153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:45:18.829915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:18.831182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:18.834906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 621/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:18.837459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:18.891471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:18.955137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad044-45f1-4df3-b208-98087875d723 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:18.998973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:18.999646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:18.999929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:19.000238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:19.001076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:19.001415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:19.003378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:19.025267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 606/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 18 14:45:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:19.031048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:19.144808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9483a1-1de8-456a-85b5-b7aee207fae8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:19.181726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:19.182525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:19.182815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:19.183096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:19.195837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:19.197628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:19.216979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:19.218148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:19.219283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:19.219283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:19.219283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:19.219283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:19.219283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 622/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:19.224053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:19.332050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855e92e-b6d1-4bc1-a566-4e9300b6b4c9 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:19.334766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:19.371311 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:19.372057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:19.372421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:19.372737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:19.373610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:19.373996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:19.375660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:19.389424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 607/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:19.395286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:19.406035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:19.510792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cadf3-ef49-4fcb-8b9a-44f963ff34a7 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:19.556479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:19.557763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:19.558051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:19.558390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:19.565710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:19.567177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:45:19.582088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:19.583224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:19.584539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 623/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:19.588986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:19.693469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228779fd-2454-4288-b205-30e589939cb2 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:19.732822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c48c6-7c75-4825-b36b-88a11f881fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:19.733490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c48c6-7c75-4825-b36b-88a11f881fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:19.733803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c48c6-7c75-4825-b36b-88a11f881fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:19.734052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c48c6-7c75-4825-b36b-88a11f881fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:19.734844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c48c6-7c75-4825-b36b-88a11f881fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:19.735189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c48c6-7c75-4825-b36b-88a11f881fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:19.736769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c48c6-7c75-4825-b36b-88a11f881fd3 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:19.749625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 608/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:19.755641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:19.835544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:19.875523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad02f5-7767-4156-8573-396669f4ee26 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:19.911743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03f228-cf6e-4318-9390-48b4f6500d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:19.912931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f228-cf6e-4318-9390-48b4f6500d9f None admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:19.913222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f228-cf6e-4318-9390-48b4f6500d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:19.913503 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f228-cf6e-4318-9390-48b4f6500d9f None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/c316d4242edf4c82afd982127603827c/roles/b26281de225b480090083648f097a6d2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:19.929372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03f228-cf6e-4318-9390-48b4f6500d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=c316d4242edf4c82afd982127603827c, role_id=b26281de225b480090083648f097a6d2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:19.930824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03f228-cf6e-4318-9390-48b4f6500d9f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:19.942310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 624/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:45:19 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/c316d4242edf4c82afd982127603827c/roles/b26281de225b480090083648f097a6d2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:45:22.328841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb0cf-1c30-4076-897c-a3a46ac0aeb0 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:22.329444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb0cf-1c30-4076-897c-a3a46ac0aeb0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:22.329444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb0cf-1c30-4076-897c-a3a46ac0aeb0 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:22.330784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 609/1233] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:22.336672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b82ab0-da6e-48bb-ba32-21f264b6eadf None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:22.337174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b82ab0-da6e-48bb-ba32-21f264b6eadf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:22.337331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b82ab0-da6e-48bb-ba32-21f264b6eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:22.354598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f9b82ab0-da6e-48bb-ba32-21f264b6eadf None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:22.355814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f9b82ab0-da6e-48bb-ba32-21f264b6eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:22.430737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 625/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:22.455953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb0cf-1c30-4076-897c-a3a46ac0aeb0 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:22.489829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:22.592197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb0cf-1c30-4076-897c-a3a46ac0aeb0 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:22.632105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:22.633171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:22.633551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:22.633988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:22.645679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:45:22.655370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:22.656865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:22.663495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 610/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 18 14:45:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:22.665586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b82ab0-da6e-48bb-ba32-21f264b6eadf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:22.715450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:22.772455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b82ab0-da6e-48bb-ba32-21f264b6eadf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:22.807835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:22.808546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:22.808891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:22.809172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:22.809958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] RBAC: Adding query filter params (name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:22.810266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:22.811702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:22.821678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 626/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 18 14:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:22.828212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:22.934591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:22.952983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c810f1-9fbb-4a51-892d-d8f033a8a282 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:22.995690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:22.996686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:22.996984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:22.997307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:23.012640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:23.014264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:23.043099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:23.044273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:23.045451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:23.045451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:23.045451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:23.045451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:23.045451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 611/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:45:23.052193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:23.164230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068645-824f-431f-88a4-3001b7c17949 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:23.174381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:23.202388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:23.203060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:23.203346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:23.203623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:23.204345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:23.204684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:23.206058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:23.217711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 627/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:45:23.223645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:23.329817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d0058-851c-4fe7-aadd-d7e947f175e7 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:23.367385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:23.368235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:23.368519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:23.368824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:23.371752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:23.378037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:23.379512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:45:23.394421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:23.396418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:23.397474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 612/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:23.401566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:23.520781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ab01-0177-49c4-966a-50ea2da41820 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:23.558195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:23.558871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:23.559157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:23.559433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:23.560275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:23.560605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:23.562058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:23.585958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 628/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 18 14:45:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:23.587192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:23.697068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f16275-0353-4cc8-96b2-04fd8a9aeba8 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:23.736442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:23.737446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:23.737875 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:23.738223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:23.803186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:23.811159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:23.812704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:23.935032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 613/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:45:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:45:23.941328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:23.973341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:24.066702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a7015-2bde-4a17-b3da-2bdb451c588c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:24.108522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:24.109353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:24.109641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:24.109921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:24.121601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:24.123082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:24.141481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:24.142610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:24.144098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:24.144098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:24.144098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:24.144098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:24.144098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 629/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:24.150041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:24.269197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:24.275843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9684-6754-468f-9ec8-e8dbc5ddf867 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:24.312718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:24.313420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:24.313674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:24.313962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:24.314708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:24.315020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:24.316960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:24.329057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 614/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:24.335231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:24.417676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:24.443397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c60a40-cc61-47dd-b362-d8c80f0348f4 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:24.481753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:24.482532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:24.482857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:24.483161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:24.490876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:24.492608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:45:24.508471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:24.514895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:24.516106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 630/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:45:24.516731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:24.626615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21d5ae-6926-40c2-87a9-92f66031e22c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:24.667467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2ffea-4adb-4ac4-9eaa-4e3e4c1c96de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:24.668135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2ffea-4adb-4ac4-9eaa-4e3e4c1c96de None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:24.668419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2ffea-4adb-4ac4-9eaa-4e3e4c1c96de None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:24.668727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2ffea-4adb-4ac4-9eaa-4e3e4c1c96de None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:24.669514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2ffea-4adb-4ac4-9eaa-4e3e4c1c96de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:24.669825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2ffea-4adb-4ac4-9eaa-4e3e4c1c96de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:24.671588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2ffea-4adb-4ac4-9eaa-4e3e4c1c96de None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:24.684649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 615/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:45:24.691762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:24.802435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dfbd1-5a65-48e8-9d7e-ff9a2570190c None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:24.840508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d59d9-a3e0-423d-aa70-0ec8c0f9bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:24.841184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d59d9-a3e0-423d-aa70-0ec8c0f9bbcb None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:24.841467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d59d9-a3e0-423d-aa70-0ec8c0f9bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:24.841743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d59d9-a3e0-423d-aa70-0ec8c0f9bbcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:24.842561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d59d9-a3e0-423d-aa70-0ec8c0f9bbcb None admin] RBAC: Adding query filter params (role.id=b26281de225b480090083648f097a6d2, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=c316d4242edf4c82afd982127603827c) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:24.842874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d59d9-a3e0-423d-aa70-0ec8c0f9bbcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:24.844447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d59d9-a3e0-423d-aa70-0ec8c0f9bbcb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:24.851609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 631/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:45:24 2022] GET /identity/v3/role_assignments?user.id=c316d4242edf4c82afd982127603827c&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=b26281de225b480090083648f097a6d2 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:27.430517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294afd1c-d18c-4c57-9a28-04fefc28ad38 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:27.431226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294afd1c-d18c-4c57-9a28-04fefc28ad38 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:27.431226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294afd1c-d18c-4c57-9a28-04fefc28ad38 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:27.432690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 616/1247] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:45:27.438258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7dc4-2dfb-4add-b851-7c0c8c4c6ad5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:27.438740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7dc4-2dfb-4add-b851-7c0c8c4c6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:27.439279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7dc4-2dfb-4add-b851-7c0c8c4c6ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:27.445173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:27.461757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-163b7dc4-2dfb-4add-b851-7c0c8c4c6ad5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:27.463464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-163b7dc4-2dfb-4add-b851-7c0c8c4c6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:27.545794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 632/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:45:27.576337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294afd1c-d18c-4c57-9a28-04fefc28ad38 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:27.595172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:27.689224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294afd1c-d18c-4c57-9a28-04fefc28ad38 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:27.724664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:27.725467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:27.725700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:27.725975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:27.736513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:45:27.744830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:27.746013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:27.747195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 617/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:27.752132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7dc4-2dfb-4add-b851-7c0c8c4c6ad5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:27.865442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7dc4-2dfb-4add-b851-7c0c8c4c6ad5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:27.898668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:27.904529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:27.905258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:27.905546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:27.905824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:27.906586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:27.906898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:27.908430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:27.923796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 633/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:27.925566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:28.010686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:28.039326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8756cd7-32eb-46b1-8291-3e0e86946f7b None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:28.074675 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:28.075476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:28.075764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:28.076071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:28.088181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:28.089747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:28.108164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:28.109529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:28.110802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:28.110802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:28.110802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:28.110802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:28.110802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 618/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:28.116608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:28.225883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89aa6f1-1e18-4aa3-9a4d-a6209ae86aca None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:28.260352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:28.261105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:28.261336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:28.261621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:28.262340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:28.262656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:28.264019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:28.276394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 634/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:28.282363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:28.395034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607b325-5367-4a5d-8b20-9e7f3b9df3f7 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:28.423848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:28.433506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:28.434360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:28.434644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:28.434970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] PATH_INFO: `/v3/users/placement` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:28.443777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:28.445275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:45:28.460157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:28.461638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:28.462700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 619/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:28.467577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:28.525663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:28.572879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365a20c-3738-4b7e-9685-770dca52268f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:28.609141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:28.609838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:28.610104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:28.610386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:28.611229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:28.611544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:28.613041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:28.630860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 635/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 18 14:45:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:28.637152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:28.749171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b140a-fe8a-48ae-ad8a-b9ae0d6860da None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:28.784734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:28.785443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:28.785800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:28.786085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:28.851254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:28.866554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:28.868345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:28.979794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 620/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:45:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:45:28.985747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:29.101968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da5581-2637-4ebc-842b-dac358cfdbb6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:29.116260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:29.139242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:29.140074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:29.140363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:29.140676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:29.152201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:29.153712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:29.172530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:29.173725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:29.175220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:29.175220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:29.175220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:29.175220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:29.175220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 636/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:45:29.180295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:29.273075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:29.286617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f805964-0099-47f8-bc0c-d9bd414161e1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:29.323041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:29.323723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:29.324004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:29.324278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:29.325037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:29.325343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:29.326731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:29.339511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 621/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:29.345231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:29.449843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8b72-523d-437b-847c-bbf8dfc4049e None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:29.485007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:29.485799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:29.486082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:29.486360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:29.493091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:29.494543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:45:29.509021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:29.510077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:29.511179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 637/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:29.516189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:29.617019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ac355-8fde-4ff2-83ef-44d8450e24fc None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:29.651573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b0878-0614-430f-a77c-574b417b4050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:29.652243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0878-0614-430f-a77c-574b417b4050 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:29.652530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0878-0614-430f-a77c-574b417b4050 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:29.652850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0878-0614-430f-a77c-574b417b4050 None admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:29.653636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b0878-0614-430f-a77c-574b417b4050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:29.653951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b0878-0614-430f-a77c-574b417b4050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:29.655395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b0878-0614-430f-a77c-574b417b4050 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:29.667894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 622/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:29.674835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:29.702428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:29.775239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18f9d-fcaf-40d3-bc02-302e0f723c7f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:29.807449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc54c2-cf6a-47ef-aaf0-91fffc3d991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:29.808097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc54c2-cf6a-47ef-aaf0-91fffc3d991e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:29.808384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc54c2-cf6a-47ef-aaf0-91fffc3d991e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:29.808698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc54c2-cf6a-47ef-aaf0-91fffc3d991e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:29.809517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc54c2-cf6a-47ef-aaf0-91fffc3d991e None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=c316d4242edf4c82afd982127603827c) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:29.809832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc54c2-cf6a-47ef-aaf0-91fffc3d991e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:29.811248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc54c2-cf6a-47ef-aaf0-91fffc3d991e None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:29.817135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 638/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:45:29 2022] GET /identity/v3/role_assignments?user.id=c316d4242edf4c82afd982127603827c&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:32.002942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec45df9-0f0b-4a67-b9b6-5f851eb60561 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:32.004001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec45df9-0f0b-4a67-b9b6-5f851eb60561 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:32.004316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec45df9-0f0b-4a67-b9b6-5f851eb60561 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:32.006106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 623/1261] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:32.011402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2d0b-e993-4570-b4a2-fca2b621e767 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:32.011902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2d0b-e993-4570-b4a2-fca2b621e767 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:32.012053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2d0b-e993-4570-b4a2-fca2b621e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:32.032508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-903c2d0b-e993-4570-b4a2-fca2b621e767 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:32.033768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-903c2d0b-e993-4570-b4a2-fca2b621e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:32.099254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 639/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:32.121754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec45df9-0f0b-4a67-b9b6-5f851eb60561 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:32.133074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:32.220811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec45df9-0f0b-4a67-b9b6-5f851eb60561 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:32.255133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:32.255866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:32.256156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:32.256436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:32.267433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:45:32.275306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:32.276406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:32.277625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 624/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:45:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:32.282434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2d0b-e993-4570-b4a2-fca2b621e767 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:32.301635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:32.378780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2d0b-e993-4570-b4a2-fca2b621e767 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:32.411659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:32.412329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:32.412646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:32.412932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:32.413674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:32.414014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:32.415383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:32.423512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 640/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:45:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:32.430485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:32.495935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:32.529470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ecabd-988b-4f7e-ab73-505cabed8641 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:32.562551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:32.563337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:32.563625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:32.563903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:32.574166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:32.575633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:32.592392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:32.593426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:32.599382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:32.599382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:32.599382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:32.599382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:32.599382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 625/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:32.599725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:32.678854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:32.698251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34931-ef34-4685-bb54-91cde3c9f4c6 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:32.729975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:32.730622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:32.730904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:32.731179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:32.731885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:32.732189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:32.733567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:32.745606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 641/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:32.751206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:32.847863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05206-b666-46ad-9841-686fd69e0726 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:32.867146 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:32.881540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:32.882330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:32.882616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:32.882896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:32.890213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:32.891664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:45:32.905850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:32.906951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:32.908122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 626/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:32.912792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:33.018739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cb059-1b6e-4d23-8032-8a1740501e16 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:33.053034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:33.053695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:33.053984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:33.054265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:33.055090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:33.055404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:33.056866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:33.065499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:33.074002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 642/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 18 14:45:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:33.079654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:33.184780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81573-e63d-44fd-a15b-dfd84510ebe0 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:33.217933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:33.218729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:33.219018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:33.219300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:33.230215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:33.231766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:33.249208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:33.250250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:33.251209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:33.251209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:33.251209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:33.251209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:33.251209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 627/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:33.255968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:33.372177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5d6d4-ef9d-4dd2-9c3c-b2883343708d None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:33.405189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:33.405838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:33.406126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:33.406401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:33.407109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:33.407413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:33.409355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:33.420008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 643/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:33.426017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:33.457399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:33.524385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b482e-43b9-48bf-9b4b-fbbf9f1dacc6 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:33.558920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:33.559702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:33.559988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:33.560266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:33.566883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:33.568344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:45:33.582980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:33.584021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:33.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 628/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:33.589871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:33.647173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:33.693423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6ac4-2925-4ca1-baf0-b777f62ce2b8 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:33.727597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbfb59-efe0-4064-8c0d-6024f5e30690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:33.728188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbfb59-efe0-4064-8c0d-6024f5e30690 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:33.728478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbfb59-efe0-4064-8c0d-6024f5e30690 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:33.728790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbfb59-efe0-4064-8c0d-6024f5e30690 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:33.729574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbfb59-efe0-4064-8c0d-6024f5e30690 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:33.729889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbfb59-efe0-4064-8c0d-6024f5e30690 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:33.731322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbfb59-efe0-4064-8c0d-6024f5e30690 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:33.742976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 644/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:33.748987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:33.838121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:33.847127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d030-f7d8-4870-831a-2974563e9ce6 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:33.880851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f1eb-21cf-434b-a640-31bcfcf3377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:33.881732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f1eb-21cf-434b-a640-31bcfcf3377c None admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:33.882019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f1eb-21cf-434b-a640-31bcfcf3377c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:33.882298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f1eb-21cf-434b-a640-31bcfcf3377c None admin] PATH_INFO: `/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/c316d4242edf4c82afd982127603827c/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:33.884225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f1eb-21cf-434b-a640-31bcfcf3377c None admin] RBAC: Authorizing `identity:create_grant(project_id=a2316792c91e4ecca634b4255749cbc6, user_id=c316d4242edf4c82afd982127603827c, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:33.885699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f1eb-21cf-434b-a640-31bcfcf3377c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:33.899329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 629/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 18 14:45:33 2022] PUT /identity/v3/projects/a2316792c91e4ecca634b4255749cbc6/users/c316d4242edf4c82afd982127603827c/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:45:36.091714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ffefa-89e2-4e76-b284-31b0c51ef1fa None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:36.092268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ffefa-89e2-4e76-b284-31b0c51ef1fa None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:36.092268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ffefa-89e2-4e76-b284-31b0c51ef1fa None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:36.093677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 645/1274] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:36.099559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008607-179c-473f-9318-910d8877dcaa None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:36.099956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008607-179c-473f-9318-910d8877dcaa None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:36.100127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008607-179c-473f-9318-910d8877dcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:36.116816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-18008607-179c-473f-9318-910d8877dcaa None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:36.118014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-18008607-179c-473f-9318-910d8877dcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:36.183826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 630/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:36.206326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ffefa-89e2-4e76-b284-31b0c51ef1fa None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:36.306289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ffefa-89e2-4e76-b284-31b0c51ef1fa None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:36.322831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:36.340067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:36.340881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:36.341170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:36.341453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:36.351843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:45:36.359662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:36.360811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:36.362585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 646/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 18 14:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:36.367431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008607-179c-473f-9318-910d8877dcaa None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:36.450007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:36.469035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008607-179c-473f-9318-910d8877dcaa None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:36.501167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:36.501830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:36.502135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:36.502351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:36.503094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:36.503409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:36.504847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:36.513179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 631/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 18 14:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:36.519358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:36.616123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c9af-98ff-44ca-8ff0-412a6f78c59e None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:36.648510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:36.649324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:36.649613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:36.649895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:36.660755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:36.662194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:36.679719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:36.680795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:36.681775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:36.681775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:36.681775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:36.681775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:36.681775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 647/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:36.686412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:36.782440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc93f-2030-4353-96e3-f1a4c2fb6c44 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:36.816166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:36.816854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:36.817140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:36.817421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:36.818136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:36.818448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:36.819827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:36.830809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 632/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:36.836328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:36.866905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:36.933387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142022-3d43-43db-9aa6-9e1ab025622f None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:36.964833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:36.965683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:36.966000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:36.966244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:36.975393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:36.976912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:45:36.992608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:36.993750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:36.994850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 648/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:36.999944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:37.004478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:37.102594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57d11b-a547-4921-90b1-4927b01a876c None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:37.135157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:37.135756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:37.136041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:37.136319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:37.137179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:37.137498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:37.138937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:37.156553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 633/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 18 14:45:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:37.163902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:37.256419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:37.266403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6e0f8-c2d1-4b66-81b3-6cebd9b42260 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:37.299717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:37.300358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:37.300675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:37.300958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:37.365538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:37.366973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:37.458879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:37.469295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 649/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 18 14:45:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:45:37.475591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:37.534906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:37.573624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb240062-ec22-43d8-af60-a0c8c6ae0de1 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:37.606454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:37.607243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:37.607527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:37.607814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:37.617558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:37.619011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:45:37.637430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:37.638442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:37.639724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:45:37.639724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:45:37.639724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:45:37.639724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:37.639724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 634/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:37.644682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:37.747030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1594b8-907d-4d1c-8d43-763d4cb31274 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:37.780291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:37.780979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:37.781267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:37.781548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:37.782267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:37.782581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:37.783981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:37.794821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 650/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 18 14:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:37.800679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:37.896505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68d3a-5c3f-4329-b9c8-7e3fd168b0ff None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:37.909864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:37.929955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:37.930734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:37.931016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:37.931292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:37.937723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:37.939168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:45:37.953135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application with Lock( May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:37.954237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: ERROR keystone.server.flask.application May 18 14:45:37.955297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 635/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 18 14:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:37.960038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:38.010432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:38.067854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19523-043a-4407-bfac-4b0edc693a39 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:38.099765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8479c0-6196-42a1-ae58-bd7cb87fff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:38.100425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8479c0-6196-42a1-ae58-bd7cb87fff58 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:38.100738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8479c0-6196-42a1-ae58-bd7cb87fff58 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:38.101018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8479c0-6196-42a1-ae58-bd7cb87fff58 None admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:38.101796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8479c0-6196-42a1-ae58-bd7cb87fff58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:38.102108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8479c0-6196-42a1-ae58-bd7cb87fff58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:38.103550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8479c0-6196-42a1-ae58-bd7cb87fff58 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:38.115664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 651/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 18 14:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:38.121673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:38.221239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2b52-8434-4a89-a2d9-fe0baedac415 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:38.254242 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bb119-ea51-4382-ae29-6a50ee7295b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:38.254890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb119-ea51-4382-ae29-6a50ee7295b8 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:38.255177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb119-ea51-4382-ae29-6a50ee7295b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:38.255457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb119-ea51-4382-ae29-6a50ee7295b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:38.256275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bb119-ea51-4382-ae29-6a50ee7295b8 None admin] RBAC: Adding query filter params (role.id=d8afc9e2524f423584e6c7f3247e456e, scope.project.id=a2316792c91e4ecca634b4255749cbc6, user.id=c316d4242edf4c82afd982127603827c) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:38.256611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bb119-ea51-4382-ae29-6a50ee7295b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:38.258057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bb119-ea51-4382-ae29-6a50ee7295b8 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:38.263747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 636/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 18 14:45:38 2022] GET /identity/v3/role_assignments?user.id=c316d4242edf4c82afd982127603827c&scope.project.id=a2316792c91e4ecca634b4255749cbc6&role.id=d8afc9e2524f423584e6c7f3247e456e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:45:40.507540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f147fae-45fb-47c4-ab6d-000364382a96 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:40.508045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f147fae-45fb-47c4-ab6d-000364382a96 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:40.508045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f147fae-45fb-47c4-ab6d-000364382a96 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:40.509437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 652/1288] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:40.514489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c56d75-315c-44aa-aac3-7e1d088c3ecd None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:40.514885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c56d75-315c-44aa-aac3-7e1d088c3ecd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:40.515070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c56d75-315c-44aa-aac3-7e1d088c3ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:40.532062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-72c56d75-315c-44aa-aac3-7e1d088c3ecd None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:40.533331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-72c56d75-315c-44aa-aac3-7e1d088c3ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:40.564341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:40.601531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 637/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:40.623387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f147fae-45fb-47c4-ab6d-000364382a96 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:40.722569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f147fae-45fb-47c4-ab6d-000364382a96 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:40.732815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:40.756279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:40.757099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:40.757389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:40.757718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:40.758322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:40.759703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:40.771985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:40.773243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:40.774163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 653/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:45:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:40.779068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c56d75-315c-44aa-aac3-7e1d088c3ecd None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:40.872798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c56d75-315c-44aa-aac3-7e1d088c3ecd None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:40.905538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7f633-43c2-4666-93e4-c3b096fff090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:40.906185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7f633-43c2-4666-93e4-c3b096fff090 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:40.906463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7f633-43c2-4666-93e4-c3b096fff090 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:40.906734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7f633-43c2-4666-93e4-c3b096fff090 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:40.907422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7f633-43c2-4666-93e4-c3b096fff090 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:40.907731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7f633-43c2-4666-93e4-c3b096fff090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:40.909153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7f633-43c2-4666-93e4-c3b096fff090 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:40.913801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 638/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 18 14:45:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:40.919444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:41.031968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dce50f-a2df-4cd1-b67d-4bd74d45f2a0 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:41.069000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c00e7a-047a-43f3-9081-ce8033a2f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:41.069652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00e7a-047a-43f3-9081-ce8033a2f641 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:41.069936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00e7a-047a-43f3-9081-ce8033a2f641 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:41.070213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00e7a-047a-43f3-9081-ce8033a2f641 None admin] PATH_INFO: `/v3/services` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:41.070910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00e7a-047a-43f3-9081-ce8033a2f641 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:41.071217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00e7a-047a-43f3-9081-ce8033a2f641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:41.072573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00e7a-047a-43f3-9081-ce8033a2f641 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:41.076965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 654/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 18 14:45:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:43.264860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842e44-475a-4699-babd-34db97ff565b None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:43.265380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842e44-475a-4699-babd-34db97ff565b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:43.265487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4842e44-475a-4699-babd-34db97ff565b None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:43.266782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 639/1293] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:43.272363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58171dd-13c2-4122-bbe9-37666b0bc4e2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:43.272771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58171dd-13c2-4122-bbe9-37666b0bc4e2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:43.272967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58171dd-13c2-4122-bbe9-37666b0bc4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:43.289783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d58171dd-13c2-4122-bbe9-37666b0bc4e2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:43.290942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d58171dd-13c2-4122-bbe9-37666b0bc4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:43.318850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:43.355030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 655/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:43.376948 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842e44-475a-4699-babd-34db97ff565b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:43.407245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:43.476643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4842e44-475a-4699-babd-34db97ff565b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:43.508570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fb5e3-78e4-4ce3-b65e-b658c4f375dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:43.509251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fb5e3-78e4-4ce3-b65e-b658c4f375dd None admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:43.509536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fb5e3-78e4-4ce3-b65e-b658c4f375dd None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:43.509815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fb5e3-78e4-4ce3-b65e-b658c4f375dd None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:43.510536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fb5e3-78e4-4ce3-b65e-b658c4f375dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:43.511901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fb5e3-78e4-4ce3-b65e-b658c4f375dd None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:43.529105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 640/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 18 14:45:43 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:45:45.737078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36d4e3-9533-4ccc-8b1a-a74bcb5f8d6a None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:45.737641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36d4e3-9533-4ccc-8b1a-a74bcb5f8d6a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:45.737641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36d4e3-9533-4ccc-8b1a-a74bcb5f8d6a None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:45.738990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 656/1296] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:45.744190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529d20-7420-44be-95b1-5b2beb541318 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:45.744568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529d20-7420-44be-95b1-5b2beb541318 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:45.744776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529d20-7420-44be-95b1-5b2beb541318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:45.761590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-7e529d20-7420-44be-95b1-5b2beb541318 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:45.762795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7e529d20-7420-44be-95b1-5b2beb541318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:45.836630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 641/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:45.859320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36d4e3-9533-4ccc-8b1a-a74bcb5f8d6a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:45.963895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36d4e3-9533-4ccc-8b1a-a74bcb5f8d6a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:46.003913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:46.004656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:46.004942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:46.005215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:46.005858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:46.007270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:46.019444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:46.020446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:46.021367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 657/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:45:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:46.026828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e529d20-7420-44be-95b1-5b2beb541318 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:46.044408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:46.121744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e529d20-7420-44be-95b1-5b2beb541318 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:46.154380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:46.155028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:46.155308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:46.155580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:46.156266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:46.156570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:46.157953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:46.163019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 642/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 18 14:45:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:46.169013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:46.201330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:46.269063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027621-794c-4686-8028-0d4db4e9a8f9 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:46.301849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e028-8141-4f36-9124-7dbe89d380c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:46.302493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e028-8141-4f36-9124-7dbe89d380c5 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:46.302782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e028-8141-4f36-9124-7dbe89d380c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:46.303063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e028-8141-4f36-9124-7dbe89d380c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:46.303850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e028-8141-4f36-9124-7dbe89d380c5 None admin] RBAC: Adding query filter params (interface=public, service_id=fad5a31d6a284a2cb6cb941449eba133, region_id=RegionOne) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:46.304167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e028-8141-4f36-9124-7dbe89d380c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:46.305558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e028-8141-4f36-9124-7dbe89d380c5 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:46.310456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 658/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 18 14:45:46 2022] GET /identity/v3/endpoints?service_id=fad5a31d6a284a2cb6cb941449eba133&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:46.316539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:46.393618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:46.411016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df217-b348-4a7e-8c88-33f026579582 None admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:46.444034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3583d-912a-414f-902a-a6a4076ef23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:46.444708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3583d-912a-414f-902a-a6a4076ef23b None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:46.444993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3583d-912a-414f-902a-a6a4076ef23b None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:46.445268 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3583d-912a-414f-902a-a6a4076ef23b None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:46.445937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3583d-912a-414f-902a-a6a4076ef23b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:46.447292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3583d-912a-414f-902a-a6a4076ef23b None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:46.453863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 643/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 18 14:45:46 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:45:48.650950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9b696-c85a-4a35-adfa-e7d3c09237d9 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:48.651452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9b696-c85a-4a35-adfa-e7d3c09237d9 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:48.651452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9b696-c85a-4a35-adfa-e7d3c09237d9 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:48.652840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 659/1302] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:45:48.658012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d7d7-b7b4-42d8-9484-2f14320a7542 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:48.658442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d7d7-b7b4-42d8-9484-2f14320a7542 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:48.658580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d7d7-b7b4-42d8-9484-2f14320a7542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:48.676171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-cb48d7d7-b7b4-42d8-9484-2f14320a7542 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:45:48.677393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cb48d7d7-b7b4-42d8-9484-2f14320a7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:45:48.742068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 644/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:45:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:45:48.764835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9b696-c85a-4a35-adfa-e7d3c09237d9 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:48.864380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:48.874595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9b696-c85a-4a35-adfa-e7d3c09237d9 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:48.910935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:48.911668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:48.912348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:48.913091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:48.913750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:48.915114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:45:48.927772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:45:48.928973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application with Lock( May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self._enter() May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application return self.creator() May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application created_value = creator( May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: ERROR keystone.server.flask.application May 18 14:45:48.930009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 660/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 18 14:45:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:45:48.935180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48d7d7-b7b4-42d8-9484-2f14320a7542 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:49.020741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:49.045345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48d7d7-b7b4-42d8-9484-2f14320a7542 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:49.078747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41ca0d-3838-4269-bbca-9966082198ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:49.079415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41ca0d-3838-4269-bbca-9966082198ca None admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:49.079702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41ca0d-3838-4269-bbca-9966082198ca None admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:49.079985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41ca0d-3838-4269-bbca-9966082198ca None admin] PATH_INFO: `/v3/services` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:49.081272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41ca0d-3838-4269-bbca-9966082198ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:45:49.081586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41ca0d-3838-4269-bbca-9966082198ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:49.082968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41ca0d-3838-4269-bbca-9966082198ca None admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:49.087987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 645/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 18 14:45:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:45:49.093672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:45:49.210688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b6e37-c939-4070-a637-aad81f4f1082 None admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:45:49.257082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c0c41-94cf-4d28-84b5-a8620d249ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:45:49.257742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c0c41-94cf-4d28-84b5-a8620d249ddb None admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:45:49.258028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c0c41-94cf-4d28-84b5-a8620d249ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:45:49.258305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c0c41-94cf-4d28-84b5-a8620d249ddb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:45:49.259453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c0c41-94cf-4d28-84b5-a8620d249ddb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:45:49.261290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c0c41-94cf-4d28-84b5-a8620d249ddb None admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:45:49.281695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 661/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 18 14:45:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:45:59.085176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=30 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:45:59.277253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:46:53.266352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a609-a20f-4405-a085-d98afff93673 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:53.266936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a609-a20f-4405-a085-d98afff93673 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:53.266936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a609-a20f-4405-a085-d98afff93673 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:53.273697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09aead-68af-40b4-8bb3-1b8dcec1a7b4 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:53.274163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09aead-68af-40b4-8bb3-1b8dcec1a7b4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:53.274257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09aead-68af-40b4-8bb3-1b8dcec1a7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:53.277727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 646/1307] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:46:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:46:53.365031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-6d09aead-68af-40b4-8bb3-1b8dcec1a7b4 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:46:53.366147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-6d09aead-68af-40b4-8bb3-1b8dcec1a7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:53.477410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 662/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:46:53.528415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573a1e-9b98-4182-bc64-5481cfb007f1 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:53.529034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573a1e-9b98-4182-bc64-5481cfb007f1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:53.529323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573a1e-9b98-4182-bc64-5481cfb007f1 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:53.530892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 647/1309] 10.222.0.59 () {54 vars in 964 bytes} [Wed May 18 14:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:46:53.536764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c704b-092b-4386-a8ed-84635cef56f2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:53.537064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c704b-092b-4386-a8ed-84635cef56f2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:53.537350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c704b-092b-4386-a8ed-84635cef56f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:53.631314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b19c704b-092b-4386-a8ed-84635cef56f2 None None] MFA Rules not processed for user `1aa975bb70624500aa802e7a708014c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:46:53.632744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b19c704b-092b-4386-a8ed-84635cef56f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:53.656560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:46:53.718557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 663/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Wed May 18 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:46:53.727744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573a1e-9b98-4182-bc64-5481cfb007f1 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:46:53.729541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1a573a1e-9b98-4182-bc64-5481cfb007f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:53.857319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573a1e-9b98-4182-bc64-5481cfb007f1 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:46:53.942616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14322c34-0a58-40e4-af13-fa3392df5f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:46:53.943267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322c34-0a58-40e4-af13-fa3392df5f27 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:53.943553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322c34-0a58-40e4-af13-fa3392df5f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:53.943830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322c34-0a58-40e4-af13-fa3392df5f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:53.945690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-14322c34-0a58-40e4-af13-fa3392df5f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:54.007694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:46:54.068380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322c34-0a58-40e4-af13-fa3392df5f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:46:54.070060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322c34-0a58-40e4-af13-fa3392df5f27 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:46:54.089584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 648/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:46:56.596129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0e9fc-803f-4b9b-9b57-edda9c1f40af None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:56.596644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0e9fc-803f-4b9b-9b57-edda9c1f40af None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:56.596644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0e9fc-803f-4b9b-9b57-edda9c1f40af None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:56.598021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 664/1312] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:46:56.603225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80deb-d768-407a-b53c-eafbfd21e110 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:56.603635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80deb-d768-407a-b53c-eafbfd21e110 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:56.603780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80deb-d768-407a-b53c-eafbfd21e110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:56.674982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1bb80deb-d768-407a-b53c-eafbfd21e110 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:46:56.676178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1bb80deb-d768-407a-b53c-eafbfd21e110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:56.774150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 649/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:46:56.811571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0e9fc-803f-4b9b-9b57-edda9c1f40af None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:46:56.813186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-57c0e9fc-803f-4b9b-9b57-edda9c1f40af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:56.925458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0e9fc-803f-4b9b-9b57-edda9c1f40af None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:46:56.995957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:46:56.998966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461f131-3b7e-4633-9418-277927e6f290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:46:57.000368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f131-3b7e-4633-9418-277927e6f290 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:57.000872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f131-3b7e-4633-9418-277927e6f290 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:57.001341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f131-3b7e-4633-9418-277927e6f290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:57.003116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4461f131-3b7e-4633-9418-277927e6f290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:57.113333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461f131-3b7e-4633-9418-277927e6f290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:46:57.114813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461f131-3b7e-4633-9418-277927e6f290 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:46:57.132676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 665/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:46:59.703773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717bf72-928d-4490-b125-51d938ce1c55 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:59.704314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717bf72-928d-4490-b125-51d938ce1c55 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:59.704314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717bf72-928d-4490-b125-51d938ce1c55 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:59.705722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 650/1315] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:46:59.710832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07e8d9-1aa1-4b7b-9ab9-6a1b0ff692e1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:46:59.711254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07e8d9-1aa1-4b7b-9ab9-6a1b0ff692e1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:46:59.711426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07e8d9-1aa1-4b7b-9ab9-6a1b0ff692e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:46:59.775578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-af07e8d9-1aa1-4b7b-9ab9-6a1b0ff692e1 None None] MFA Rules not processed for user `8ac033f9505f4cb0aca3a79776c62469`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:46:59.776815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-af07e8d9-1aa1-4b7b-9ab9-6a1b0ff692e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:59.828775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:46:59.874086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 666/1316] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:46:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:46:59.914242 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717bf72-928d-4490-b125-51d938ce1c55 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:46:59.915830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d717bf72-928d-4490-b125-51d938ce1c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:46:59.926803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:00.035553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717bf72-928d-4490-b125-51d938ce1c55 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:00.116031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff608ffc-20a3-4c55-84a5-3cf5e47441f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:00.117042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608ffc-20a3-4c55-84a5-3cf5e47441f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:00.117330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608ffc-20a3-4c55-84a5-3cf5e47441f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:00.117604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608ffc-20a3-4c55-84a5-3cf5e47441f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:00.119331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ff608ffc-20a3-4c55-84a5-3cf5e47441f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:00.182700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:00.235670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff608ffc-20a3-4c55-84a5-3cf5e47441f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:00.237166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff608ffc-20a3-4c55-84a5-3cf5e47441f2 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:00.255440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 651/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:46:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:03.029777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b1d9-073b-4177-8049-226bdb577358 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:03.030685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b1d9-073b-4177-8049-226bdb577358 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:03.030867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b1d9-073b-4177-8049-226bdb577358 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:03.032261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 667/1318] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:03.037732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76defc-70b8-495e-8546-d9a4a70a3dee None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:03.038133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76defc-70b8-495e-8546-d9a4a70a3dee None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:03.038307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76defc-70b8-495e-8546-d9a4a70a3dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:03.101774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-cb76defc-70b8-495e-8546-d9a4a70a3dee None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:03.102983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cb76defc-70b8-495e-8546-d9a4a70a3dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:03.198022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 652/1319] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:03.236565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0b1d9-073b-4177-8049-226bdb577358 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:03.238171 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3cb0b1d9-073b-4177-8049-226bdb577358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:03.338983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0b1d9-073b-4177-8049-226bdb577358 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:03.411381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7842d-9b62-42c6-a8ea-79dc57070343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:03.412018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7842d-9b62-42c6-a8ea-79dc57070343 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:03.412306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7842d-9b62-42c6-a8ea-79dc57070343 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:03.412607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7842d-9b62-42c6-a8ea-79dc57070343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:03.414227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-31f7842d-9b62-42c6-a8ea-79dc57070343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:03.420956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:03.520361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7842d-9b62-42c6-a8ea-79dc57070343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:03.521840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7842d-9b62-42c6-a8ea-79dc57070343 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:03.539996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 668/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:06.396478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214386-dea7-401d-b629-b8047cd7abce None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:06.397064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214386-dea7-401d-b629-b8047cd7abce None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:06.397064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214386-dea7-401d-b629-b8047cd7abce None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:06.398452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 653/1321] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:06.403642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec338a-1bc9-44e1-8801-47199d17e44a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:06.404023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec338a-1bc9-44e1-8801-47199d17e44a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:06.404328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec338a-1bc9-44e1-8801-47199d17e44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:06.469860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d4ec338a-1bc9-44e1-8801-47199d17e44a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:06.470984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d4ec338a-1bc9-44e1-8801-47199d17e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:06.527545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:06.565894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 669/1322] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:06.601857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b214386-dea7-401d-b629-b8047cd7abce None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:06.603413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1b214386-dea7-401d-b629-b8047cd7abce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:06.622258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:06.707974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b214386-dea7-401d-b629-b8047cd7abce None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:06.783105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98493d-8cd7-438c-b404-751146aa6391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:06.783677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98493d-8cd7-438c-b404-751146aa6391 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:06.784376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98493d-8cd7-438c-b404-751146aa6391 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:06.784689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98493d-8cd7-438c-b404-751146aa6391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:06.786355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-3c98493d-8cd7-438c-b404-751146aa6391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:06.871021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:06.909857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98493d-8cd7-438c-b404-751146aa6391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:06.911323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98493d-8cd7-438c-b404-751146aa6391 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:06.930066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 654/1323] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:09.231018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919a57-9338-4b0a-85c7-350b674110a0 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:09.231580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919a57-9338-4b0a-85c7-350b674110a0 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:09.231580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919a57-9338-4b0a-85c7-350b674110a0 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:09.233838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 670/1324] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:09.239292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362dcd-e8ac-4d3a-a61f-d7404f52c675 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:09.239739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362dcd-e8ac-4d3a-a61f-d7404f52c675 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:09.239842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362dcd-e8ac-4d3a-a61f-d7404f52c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:09.310453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-37362dcd-e8ac-4d3a-a61f-d7404f52c675 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:09.311569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-37362dcd-e8ac-4d3a-a61f-d7404f52c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:09.408163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 655/1325] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:09.459520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef7c3-b3ff-4f79-8084-23eb50b16a49 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:09.459810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef7c3-b3ff-4f79-8084-23eb50b16a49 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:09.460092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef7c3-b3ff-4f79-8084-23eb50b16a49 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:09.461505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 671/1326] 10.222.0.59 () {54 vars in 964 bytes} [Wed May 18 14:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:09.468280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d5b7-a41f-4ee2-b9cf-e750a9e9128f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:09.468569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d5b7-a41f-4ee2-b9cf-e750a9e9128f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:09.468896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d5b7-a41f-4ee2-b9cf-e750a9e9128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:09.498059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:09.543424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f9a0d5b7-a41f-4ee2-b9cf-e750a9e9128f None None] MFA Rules not processed for user `1aa975bb70624500aa802e7a708014c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:09.544651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f9a0d5b7-a41f-4ee2-b9cf-e750a9e9128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:09.620014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 656/1327] 10.222.0.59 () {58 vars in 1061 bytes} [Wed May 18 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:47:09.629147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef7c3-b3ff-4f79-8084-23eb50b16a49 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:09.630754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-db7ef7c3-b3ff-4f79-8084-23eb50b16a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:09.732819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef7c3-b3ff-4f79-8084-23eb50b16a49 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:09.805860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30550a3c-d60b-42f0-87d4-7faa649d7529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:09.806509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550a3c-d60b-42f0-87d4-7faa649d7529 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:09.806799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550a3c-d60b-42f0-87d4-7faa649d7529 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:09.807088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550a3c-d60b-42f0-87d4-7faa649d7529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:09.808771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-30550a3c-d60b-42f0-87d4-7faa649d7529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:09.825304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:09.918781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30550a3c-d60b-42f0-87d4-7faa649d7529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:09.920253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30550a3c-d60b-42f0-87d4-7faa649d7529 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:09.939735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 672/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:12.426175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ed85c-6dbe-4dbc-b16b-4f5126dce7d5 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:12.426741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ed85c-6dbe-4dbc-b16b-4f5126dce7d5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:12.426741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ed85c-6dbe-4dbc-b16b-4f5126dce7d5 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:12.428110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 657/1329] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:12.433573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d534da-b43e-4d00-a0ef-52939d272ace None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:12.433986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d534da-b43e-4d00-a0ef-52939d272ace None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:12.434147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d534da-b43e-4d00-a0ef-52939d272ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:12.497999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b4d534da-b43e-4d00-a0ef-52939d272ace None None] MFA Rules not processed for user `8ac033f9505f4cb0aca3a79776c62469`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:12.499155 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b4d534da-b43e-4d00-a0ef-52939d272ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:12.566626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:12.600952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 673/1330] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:12.637699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ed85c-6dbe-4dbc-b16b-4f5126dce7d5 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:12.639757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-787ed85c-6dbe-4dbc-b16b-4f5126dce7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:12.743708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ed85c-6dbe-4dbc-b16b-4f5126dce7d5 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:12.762876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:12.818412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127102-eb4b-4810-a7d7-f7cd03f1729d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:12.819066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127102-eb4b-4810-a7d7-f7cd03f1729d service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:12.819355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127102-eb4b-4810-a7d7-f7cd03f1729d service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:12.819638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127102-eb4b-4810-a7d7-f7cd03f1729d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:12.821383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-02127102-eb4b-4810-a7d7-f7cd03f1729d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:12.933324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02127102-eb4b-4810-a7d7-f7cd03f1729d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:12.934788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02127102-eb4b-4810-a7d7-f7cd03f1729d service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:12.954029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 658/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:15.584742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81128f3-0e9d-4eb2-a833-2a92e0ba25fd None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:15.585296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81128f3-0e9d-4eb2-a833-2a92e0ba25fd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:15.585296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81128f3-0e9d-4eb2-a833-2a92e0ba25fd None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:15.586679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 674/1332] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:15.591989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f4c53-6166-4f28-b41b-d21f5c95dc8a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:15.593041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f4c53-6166-4f28-b41b-d21f5c95dc8a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:15.593331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f4c53-6166-4f28-b41b-d21f5c95dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:15.659308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:15.662930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b15f4c53-6166-4f28-b41b-d21f5c95dc8a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:15.664739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b15f4c53-6166-4f28-b41b-d21f5c95dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:15.765367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 659/1333] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:15.801539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81128f3-0e9d-4eb2-a833-2a92e0ba25fd None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:15.803076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d81128f3-0e9d-4eb2-a833-2a92e0ba25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:15.912222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81128f3-0e9d-4eb2-a833-2a92e0ba25fd None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:15.989065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23441f8-f792-4d15-a3e2-8fc6e3a451fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:15.989725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23441f8-f792-4d15-a3e2-8fc6e3a451fd service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:15.990010 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23441f8-f792-4d15-a3e2-8fc6e3a451fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:15.990318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23441f8-f792-4d15-a3e2-8fc6e3a451fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:15.991967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b23441f8-f792-4d15-a3e2-8fc6e3a451fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:16.019636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:16.102417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23441f8-f792-4d15-a3e2-8fc6e3a451fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:16.103847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23441f8-f792-4d15-a3e2-8fc6e3a451fd service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:16.121844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 675/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:18.371894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bbd9e-8c38-46df-baa9-fe05ddca6c2c None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:18.372419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bbd9e-8c38-46df-baa9-fe05ddca6c2c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:18.372544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bbd9e-8c38-46df-baa9-fe05ddca6c2c None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:18.373870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 660/1335] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:18.379406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f2f0a-9c67-4094-8932-63723b872f95 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:18.379853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f2f0a-9c67-4094-8932-63723b872f95 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:18.379970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f2f0a-9c67-4094-8932-63723b872f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:18.443748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-744f2f0a-9c67-4094-8932-63723b872f95 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:18.444969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-744f2f0a-9c67-4094-8932-63723b872f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:18.517168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:18.540128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 676/1336] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:18.579619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bbd9e-8c38-46df-baa9-fe05ddca6c2c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:18.581201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ec6bbd9e-8c38-46df-baa9-fe05ddca6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:18.681963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bbd9e-8c38-46df-baa9-fe05ddca6c2c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:18.709543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:18.754116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981b144-505b-4db0-a382-32fdc346b259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:18.754759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b144-505b-4db0-a382-32fdc346b259 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:18.755043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b144-505b-4db0-a382-32fdc346b259 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:18.755322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b144-505b-4db0-a382-32fdc346b259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:18.756977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7981b144-505b-4db0-a382-32fdc346b259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:18.863779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b144-505b-4db0-a382-32fdc346b259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:18.865189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b144-505b-4db0-a382-32fdc346b259 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:18.883038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 661/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:21.577731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff8332-10a5-48ac-8e43-649e09db9266 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:21.578286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff8332-10a5-48ac-8e43-649e09db9266 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:21.578286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff8332-10a5-48ac-8e43-649e09db9266 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:21.579667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 677/1338] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:21.585020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff2e6-2e9b-4ebc-a9da-4c7383538478 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:21.585428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff2e6-2e9b-4ebc-a9da-4c7383538478 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:21.585583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff2e6-2e9b-4ebc-a9da-4c7383538478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:21.653569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9dbff2e6-2e9b-4ebc-a9da-4c7383538478 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:21.655349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9dbff2e6-2e9b-4ebc-a9da-4c7383538478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:21.663578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:21.749392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 662/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:21.786072 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff8332-10a5-48ac-8e43-649e09db9266 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:21.787595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-18ff8332-10a5-48ac-8e43-649e09db9266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:21.889792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff8332-10a5-48ac-8e43-649e09db9266 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:21.961291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72745fc-47d8-4d53-a6c0-04bac4697757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:21.961929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72745fc-47d8-4d53-a6c0-04bac4697757 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:21.962213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72745fc-47d8-4d53-a6c0-04bac4697757 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:21.962493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72745fc-47d8-4d53-a6c0-04bac4697757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:21.964109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a72745fc-47d8-4d53-a6c0-04bac4697757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:22.002095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:22.074211 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72745fc-47d8-4d53-a6c0-04bac4697757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:22.075645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72745fc-47d8-4d53-a6c0-04bac4697757 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:22.093720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 678/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:26.401973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d666598-cfe0-4a66-b53a-340c8d3c40a9 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:26.402508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d666598-cfe0-4a66-b53a-340c8d3c40a9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:26.402508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d666598-cfe0-4a66-b53a-340c8d3c40a9 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:26.403833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 663/1341] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:26.410908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60c2e-cf86-4ca1-9630-759124d2abd3 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:26.411507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60c2e-cf86-4ca1-9630-759124d2abd3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:26.411839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60c2e-cf86-4ca1-9630-759124d2abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:26.492621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-52a60c2e-cf86-4ca1-9630-759124d2abd3 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:26.493764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-52a60c2e-cf86-4ca1-9630-759124d2abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:26.586973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:26.600380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 679/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:26.639687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d666598-cfe0-4a66-b53a-340c8d3c40a9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:26.641890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0d666598-cfe0-4a66-b53a-340c8d3c40a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:26.742523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d666598-cfe0-4a66-b53a-340c8d3c40a9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:26.746742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359657d1-42dc-4b8f-a8e2-1e16e20743a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:26.747395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359657d1-42dc-4b8f-a8e2-1e16e20743a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:26.747682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359657d1-42dc-4b8f-a8e2-1e16e20743a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:26.748047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359657d1-42dc-4b8f-a8e2-1e16e20743a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:26.757487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359657d1-42dc-4b8f-a8e2-1e16e20743a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:26.758934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359657d1-42dc-4b8f-a8e2-1e16e20743a3 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:26.768783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 664/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:29.558004 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b309c2-bf40-4a57-9818-520a5d60ce43 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:29.558529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b309c2-bf40-4a57-9818-520a5d60ce43 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:29.558642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b309c2-bf40-4a57-9818-520a5d60ce43 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:29.559980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 680/1344] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:29.565259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8318b32-2d38-43b5-9d3a-a989611d2649 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:29.565669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8318b32-2d38-43b5-9d3a-a989611d2649 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:29.565816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8318b32-2d38-43b5-9d3a-a989611d2649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:29.593532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c8318b32-2d38-43b5-9d3a-a989611d2649 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:29.594647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c8318b32-2d38-43b5-9d3a-a989611d2649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:29.621960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:29.674815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 665/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:29.711252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b309c2-bf40-4a57-9818-520a5d60ce43 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:29.722549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b309c2-bf40-4a57-9818-520a5d60ce43 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:29.726169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518fc5a-89c9-4c47-a828-dd03a0534217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:29.726895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518fc5a-89c9-4c47-a828-dd03a0534217 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:29.727253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518fc5a-89c9-4c47-a828-dd03a0534217 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:29.727605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518fc5a-89c9-4c47-a828-dd03a0534217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:29.736442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518fc5a-89c9-4c47-a828-dd03a0534217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:29.737905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518fc5a-89c9-4c47-a828-dd03a0534217 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:29.747277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 681/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:33.978638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f561aa1-c0f9-4a4b-99f7-a86ee742d912 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:33.979121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f561aa1-c0f9-4a4b-99f7-a86ee742d912 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:33.979237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f561aa1-c0f9-4a4b-99f7-a86ee742d912 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:33.980646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 666/1347] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:33.986562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a99ec1-8ead-466a-8ebc-a3c496ba2594 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:33.987158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a99ec1-8ead-466a-8ebc-a3c496ba2594 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:33.987300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a99ec1-8ead-466a-8ebc-a3c496ba2594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:34.006858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-25a99ec1-8ead-466a-8ebc-a3c496ba2594 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:34.008064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-25a99ec1-8ead-466a-8ebc-a3c496ba2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:34.017082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 682/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:34.053864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f561aa1-c0f9-4a4b-99f7-a86ee742d912 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:34.065487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f561aa1-c0f9-4a4b-99f7-a86ee742d912 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:34.069047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b64be-8e25-4484-a1d2-bf8e0cea82c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:34.069713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b64be-8e25-4484-a1d2-bf8e0cea82c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:34.070023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b64be-8e25-4484-a1d2-bf8e0cea82c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:34.070299 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b64be-8e25-4484-a1d2-bf8e0cea82c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:34.079796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b64be-8e25-4484-a1d2-bf8e0cea82c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:34.081257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b64be-8e25-4484-a1d2-bf8e0cea82c1 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:34.090394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 667/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:39.526204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c664e-1058-4386-99a6-7c8735db380f None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:39.526743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c664e-1058-4386-99a6-7c8735db380f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:39.526862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c664e-1058-4386-99a6-7c8735db380f None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:39.528314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 683/1350] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:39.534662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e06b77-e6af-4bf2-8c71-4146af8164f7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:39.535409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e06b77-e6af-4bf2-8c71-4146af8164f7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:39.535863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e06b77-e6af-4bf2-8c71-4146af8164f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:39.618301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-58e06b77-e6af-4bf2-8c71-4146af8164f7 None None] MFA Rules not processed for user `c316d4242edf4c82afd982127603827c`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:39.619878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-58e06b77-e6af-4bf2-8c71-4146af8164f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:39.725045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 668/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:43.971864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5d2b-ae9e-4790-8682-0dcdc7252591 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:43.972779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5d2b-ae9e-4790-8682-0dcdc7252591 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:43.973224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae5d2b-ae9e-4790-8682-0dcdc7252591 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:43.974612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 684/1352] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:43.980886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47e2b9-111b-4db8-81dc-085672697de5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:43.981380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47e2b9-111b-4db8-81dc-085672697de5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:43.982201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47e2b9-111b-4db8-81dc-085672697de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:44.001255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=13 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:44.003033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1c47e2b9-111b-4db8-81dc-085672697de5 None None] MFA Rules not processed for user `c316d4242edf4c82afd982127603827c`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:44.004296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1c47e2b9-111b-4db8-81dc-085672697de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:44.013549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 669/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:45.523849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a37c-af51-486b-8607-50f52c01665a None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:45.524543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a37c-af51-486b-8607-50f52c01665a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:45.525441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a37c-af51-486b-8607-50f52c01665a None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:45.526908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 685/1354] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:45.532463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250da73-891d-4b95-85af-4b57bf883222 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:45.532920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250da73-891d-4b95-85af-4b57bf883222 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:45.533065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250da73-891d-4b95-85af-4b57bf883222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:45.551671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-6250da73-891d-4b95-85af-4b57bf883222 None None] MFA Rules not processed for user `c316d4242edf4c82afd982127603827c`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:45.552866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6250da73-891d-4b95-85af-4b57bf883222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:45.561785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 670/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:49.470507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fe30-0473-455e-b321-1a69f212073d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:49.471429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fe30-0473-455e-b321-1a69f212073d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:49.471734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fe30-0473-455e-b321-1a69f212073d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:49.473274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 686/1356] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:49.478519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edebc7-fe76-4762-875c-d9bfde1a2750 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:49.478945 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edebc7-fe76-4762-875c-d9bfde1a2750 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:49.479127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edebc7-fe76-4762-875c-d9bfde1a2750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:49.497336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-40edebc7-fe76-4762-875c-d9bfde1a2750 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:49.498503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-40edebc7-fe76-4762-875c-d9bfde1a2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:49.506940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 671/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:49.578662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cdd93-6574-4b3e-9718-3ef4e765215c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:49.579270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cdd93-6574-4b3e-9718-3ef4e765215c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:49.579773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cdd93-6574-4b3e-9718-3ef4e765215c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:49.581513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 687/1358] 10.222.0.59 () {54 vars in 961 bytes} [Wed May 18 14:47:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:49.587663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed383a0-45c7-494f-943f-97b53a0678fd None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:49.588023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed383a0-45c7-494f-943f-97b53a0678fd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:49.588405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed383a0-45c7-494f-943f-97b53a0678fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:49.647137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:47:49.655799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-eed383a0-45c7-494f-943f-97b53a0678fd None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:49.657147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-eed383a0-45c7-494f-943f-97b53a0678fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:49.744931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 672/1359] 10.222.0.59 () {58 vars in 1058 bytes} [Wed May 18 14:47:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:49.757253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cdd93-6574-4b3e-9718-3ef4e765215c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:49.772496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cdd93-6574-4b3e-9718-3ef4e765215c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:49.779312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ad068-78f4-4e7c-933f-5f2ddff62207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:49.780180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad068-78f4-4e7c-933f-5f2ddff62207 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:49.780669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad068-78f4-4e7c-933f-5f2ddff62207 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:49.780940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad068-78f4-4e7c-933f-5f2ddff62207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:49.789998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ad068-78f4-4e7c-933f-5f2ddff62207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:49.791587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ad068-78f4-4e7c-933f-5f2ddff62207 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:49.803153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 688/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:52.268388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646930-5ac1-4dd4-8024-1b47e99737ae None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:52.268952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646930-5ac1-4dd4-8024-1b47e99737ae None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:52.269053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646930-5ac1-4dd4-8024-1b47e99737ae None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:52.270531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 673/1361] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:52.275936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095b80-52e5-4f67-b042-dbb172dc419e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:52.276386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095b80-52e5-4f67-b042-dbb172dc419e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:52.276491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095b80-52e5-4f67-b042-dbb172dc419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:52.301660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-31095b80-52e5-4f67-b042-dbb172dc419e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:52.302866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-31095b80-52e5-4f67-b042-dbb172dc419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:52.312837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 689/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:52.365812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646930-5ac1-4dd4-8024-1b47e99737ae None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:52.381661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646930-5ac1-4dd4-8024-1b47e99737ae None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:52.387446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23ed3a-10b6-4937-be84-9902aafdf8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:52.388730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23ed3a-10b6-4937-be84-9902aafdf8d7 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:52.389112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23ed3a-10b6-4937-be84-9902aafdf8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:52.389486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23ed3a-10b6-4937-be84-9902aafdf8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:52.398489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23ed3a-10b6-4937-be84-9902aafdf8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:52.400208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23ed3a-10b6-4937-be84-9902aafdf8d7 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:52.412780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 674/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:55.082806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42c59-9c13-44df-bc6d-a69942d99281 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:55.083716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42c59-9c13-44df-bc6d-a69942d99281 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:55.084149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42c59-9c13-44df-bc6d-a69942d99281 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:55.086562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 690/1364] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:55.094589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe787-6266-41a7-96d6-321a513fe862 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:55.095089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe787-6266-41a7-96d6-321a513fe862 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:55.095389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe787-6266-41a7-96d6-321a513fe862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:55.117041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-dadfe787-6266-41a7-96d6-321a513fe862 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:55.118118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dadfe787-6266-41a7-96d6-321a513fe862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:55.127501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 675/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:55.189126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511442-4c81-4d99-8ae6-e9b36b058fd0 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:55.189428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511442-4c81-4d99-8ae6-e9b36b058fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:55.189701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511442-4c81-4d99-8ae6-e9b36b058fd0 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:55.191240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 691/1366] 10.222.0.59 () {54 vars in 961 bytes} [Wed May 18 14:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:55.197786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67443b-41b8-4368-8ddb-3b62d659fde9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:55.198083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67443b-41b8-4368-8ddb-3b62d659fde9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:55.198363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67443b-41b8-4368-8ddb-3b62d659fde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:55.217368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-0b67443b-41b8-4368-8ddb-3b62d659fde9 None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:55.218713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0b67443b-41b8-4368-8ddb-3b62d659fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:55.228248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 676/1367] 10.222.0.59 () {58 vars in 1058 bytes} [Wed May 18 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:47:55.237096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df511442-4c81-4d99-8ae6-e9b36b058fd0 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:55.251705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df511442-4c81-4d99-8ae6-e9b36b058fd0 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:55.257082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720598b-c3cb-4a41-9ba2-2198f9437fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:55.257744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720598b-c3cb-4a41-9ba2-2198f9437fa8 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:55.258036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720598b-c3cb-4a41-9ba2-2198f9437fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:55.258317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720598b-c3cb-4a41-9ba2-2198f9437fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:55.266437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720598b-c3cb-4a41-9ba2-2198f9437fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:55.267975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720598b-c3cb-4a41-9ba2-2198f9437fa8 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:55.277431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 692/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:57.591483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cb53-0865-4c96-bef1-482e5161a1f5 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:57.592037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cb53-0865-4c96-bef1-482e5161a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:57.592037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cb53-0865-4c96-bef1-482e5161a1f5 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:57.593666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 677/1369] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:57.598889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97130bc-420a-4f9d-a5f0-b8b4f357d9ae None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:57.599393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97130bc-420a-4f9d-a5f0-b8b4f357d9ae None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:57.599475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97130bc-420a-4f9d-a5f0-b8b4f357d9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:57.618853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d97130bc-420a-4f9d-a5f0-b8b4f357d9ae None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:57.620948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d97130bc-420a-4f9d-a5f0-b8b4f357d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:57.629585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 693/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:57.673979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259cb53-0865-4c96-bef1-482e5161a1f5 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:57.689173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259cb53-0865-4c96-bef1-482e5161a1f5 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:57.694651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0640605-2e23-4e0b-93d0-c73c14bc8aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:57.695323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0640605-2e23-4e0b-93d0-c73c14bc8aa3 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:57.695715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0640605-2e23-4e0b-93d0-c73c14bc8aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:57.696004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0640605-2e23-4e0b-93d0-c73c14bc8aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:57.705291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0640605-2e23-4e0b-93d0-c73c14bc8aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:57.707019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0640605-2e23-4e0b-93d0-c73c14bc8aa3 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:57.717240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 678/1371] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:47:57.797341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961e9a-087d-4f24-9bc5-808b54666b85 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:57.797803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961e9a-087d-4f24-9bc5-808b54666b85 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:57.798195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961e9a-087d-4f24-9bc5-808b54666b85 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:57.799779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 694/1372] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:57.805982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8236866-4552-4574-bb9b-766123b5cb33 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:57.806354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8236866-4552-4574-bb9b-766123b5cb33 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:57.806706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8236866-4552-4574-bb9b-766123b5cb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:57.828420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e8236866-4552-4574-bb9b-766123b5cb33 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:57.829800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e8236866-4552-4574-bb9b-766123b5cb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:57.839717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 679/1373] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:58.156822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954da61-51be-4e45-92de-fed11a028fbf None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:58.157114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954da61-51be-4e45-92de-fed11a028fbf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:58.157395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954da61-51be-4e45-92de-fed11a028fbf None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:58.158907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 695/1374] 10.222.0.59 () {54 vars in 963 bytes} [Wed May 18 14:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:47:58.163899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5851-9f70-4931-8d3f-b0fa8275c79c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:58.164190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5851-9f70-4931-8d3f-b0fa8275c79c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:58.164473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5851-9f70-4931-8d3f-b0fa8275c79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:58.228276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2cea5851-9f70-4931-8d3f-b0fa8275c79c None None] MFA Rules not processed for user `6b2524791e2943c2a1eeae24e17c4f34`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:47:58.229642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2cea5851-9f70-4931-8d3f-b0fa8275c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:47:58.301102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 680/1375] 10.222.0.59 () {58 vars in 1060 bytes} [Wed May 18 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:47:58.305826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954da61-51be-4e45-92de-fed11a028fbf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:47:58.318075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954da61-51be-4e45-92de-fed11a028fbf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:47:58.322401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2755-5589-45ab-a57c-12ca478f4715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:47:58.323048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2755-5589-45ab-a57c-12ca478f4715 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:47:58.323335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2755-5589-45ab-a57c-12ca478f4715 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:47:58.323617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2755-5589-45ab-a57c-12ca478f4715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:47:58.333195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad2755-5589-45ab-a57c-12ca478f4715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:47:58.334617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad2755-5589-45ab-a57c-12ca478f4715 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:47:58.345862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 696/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:48:00.013868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840c007-e0b4-433d-9e3c-f18636ba5fdf None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:00.014837 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840c007-e0b4-433d-9e3c-f18636ba5fdf None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:00.015187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840c007-e0b4-433d-9e3c-f18636ba5fdf None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:00.016659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 681/1377] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:00.022393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeffcd-b8c2-47a4-a033-9dc69d79eeb5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:00.022931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeffcd-b8c2-47a4-a033-9dc69d79eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:00.023027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeffcd-b8c2-47a4-a033-9dc69d79eeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:00.042438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-afdeffcd-b8c2-47a4-a033-9dc69d79eeb5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:00.044337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-afdeffcd-b8c2-47a4-a033-9dc69d79eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:00.052870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 697/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:00.097321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840c007-e0b4-433d-9e3c-f18636ba5fdf None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:00.112314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840c007-e0b4-433d-9e3c-f18636ba5fdf None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:00.117819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257df49a-7c85-4d39-971a-bf40cdf447dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:00.118477 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df49a-7c85-4d39-971a-bf40cdf447dd service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:00.118760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df49a-7c85-4d39-971a-bf40cdf447dd service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:00.119037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df49a-7c85-4d39-971a-bf40cdf447dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:00.127948 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257df49a-7c85-4d39-971a-bf40cdf447dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:00.129574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257df49a-7c85-4d39-971a-bf40cdf447dd service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:00.133670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:48:00.140714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 682/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:02.422274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f214-513c-4fc0-afce-1bc11c8a68a5 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:02.422828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f214-513c-4fc0-afce-1bc11c8a68a5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:02.422828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f214-513c-4fc0-afce-1bc11c8a68a5 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:02.424460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 698/1380] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:02.429770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822c4e-eb70-406a-bfa7-6745e8aba147 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:02.430181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822c4e-eb70-406a-bfa7-6745e8aba147 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:02.430538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822c4e-eb70-406a-bfa7-6745e8aba147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:02.451041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d2822c4e-eb70-406a-bfa7-6745e8aba147 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:02.452319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d2822c4e-eb70-406a-bfa7-6745e8aba147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:02.460440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 683/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:02.504059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196f214-513c-4fc0-afce-1bc11c8a68a5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:02.519496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196f214-513c-4fc0-afce-1bc11c8a68a5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:02.525105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24accf7f-548a-49c9-94d7-e8896c04607c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:02.525881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24accf7f-548a-49c9-94d7-e8896c04607c service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:02.526272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24accf7f-548a-49c9-94d7-e8896c04607c service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:02.526654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24accf7f-548a-49c9-94d7-e8896c04607c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:02.535554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24accf7f-548a-49c9-94d7-e8896c04607c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:02.537330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24accf7f-548a-49c9-94d7-e8896c04607c service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:02.547377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 699/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:04.792112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6498d-0e85-45eb-9146-accec0e87dd0 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:04.792864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6498d-0e85-45eb-9146-accec0e87dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:04.792864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6498d-0e85-45eb-9146-accec0e87dd0 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:04.793986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 684/1383] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:04.799734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e787f-d77c-462f-bcb5-6501e56a8a1b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:04.800558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e787f-d77c-462f-bcb5-6501e56a8a1b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:04.800872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e787f-d77c-462f-bcb5-6501e56a8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:04.820896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-106e787f-d77c-462f-bcb5-6501e56a8a1b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:04.822194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-106e787f-d77c-462f-bcb5-6501e56a8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:04.831374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 700/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:48:04.874180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6498d-0e85-45eb-9146-accec0e87dd0 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:04.889451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6498d-0e85-45eb-9146-accec0e87dd0 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:04.894937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57192-22b5-43e2-9496-8103ba9a9421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:04.895605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57192-22b5-43e2-9496-8103ba9a9421 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:04.895889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57192-22b5-43e2-9496-8103ba9a9421 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:04.896164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57192-22b5-43e2-9496-8103ba9a9421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:04.906430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d57192-22b5-43e2-9496-8103ba9a9421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:04.907360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d57192-22b5-43e2-9496-8103ba9a9421 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:04.920862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 685/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:07.366601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad84df-9a8e-446e-b66b-6fec9ef4e3b6 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:07.367111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad84df-9a8e-446e-b66b-6fec9ef4e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:07.367222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad84df-9a8e-446e-b66b-6fec9ef4e3b6 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:07.368818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 701/1386] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:07.375382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ceeda-ab35-496f-a5ac-896a05f43102 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:07.375777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ceeda-ab35-496f-a5ac-896a05f43102 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:07.376087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ceeda-ab35-496f-a5ac-896a05f43102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:07.398378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b77ceeda-ab35-496f-a5ac-896a05f43102 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:07.399866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b77ceeda-ab35-496f-a5ac-896a05f43102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:07.410325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 686/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:07.462769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad84df-9a8e-446e-b66b-6fec9ef4e3b6 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:07.480110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad84df-9a8e-446e-b66b-6fec9ef4e3b6 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:07.486427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2349c3-331e-43be-8d33-24c836c37b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:07.487227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2349c3-331e-43be-8d33-24c836c37b1e service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:07.487550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2349c3-331e-43be-8d33-24c836c37b1e service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:07.487873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2349c3-331e-43be-8d33-24c836c37b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:07.497423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2349c3-331e-43be-8d33-24c836c37b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:07.499261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2349c3-331e-43be-8d33-24c836c37b1e service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:07.510163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 702/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:10.248181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadb65-b12a-4d96-9276-7d14da92af45 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:10.248732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadb65-b12a-4d96-9276-7d14da92af45 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:10.248987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadb65-b12a-4d96-9276-7d14da92af45 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:10.250758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 687/1389] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:10.256518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790093e-1980-47d9-a9ab-403b6e1ad05b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:10.256948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790093e-1980-47d9-a9ab-403b6e1ad05b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:10.257170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790093e-1980-47d9-a9ab-403b6e1ad05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:10.282701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1790093e-1980-47d9-a9ab-403b6e1ad05b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:10.283953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1790093e-1980-47d9-a9ab-403b6e1ad05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:10.292249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 703/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:10.338547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadb65-b12a-4d96-9276-7d14da92af45 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:10.353025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadb65-b12a-4d96-9276-7d14da92af45 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:10.359825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971fe78-e4f2-4497-a64a-c0297de40c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:10.360652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971fe78-e4f2-4497-a64a-c0297de40c9a service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:10.361059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971fe78-e4f2-4497-a64a-c0297de40c9a service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:10.361342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971fe78-e4f2-4497-a64a-c0297de40c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:10.370888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971fe78-e4f2-4497-a64a-c0297de40c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:10.373208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971fe78-e4f2-4497-a64a-c0297de40c9a service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:10.385461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 688/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:48:12.945585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da3a6f-33bd-4dd4-94ae-bae20887e6c3 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:12.946182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da3a6f-33bd-4dd4-94ae-bae20887e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:12.946182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da3a6f-33bd-4dd4-94ae-bae20887e6c3 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:12.947520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 704/1392] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:12.952953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18f2e-17dd-4067-a63a-032a2c421964 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:12.953361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18f2e-17dd-4067-a63a-032a2c421964 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:12.953521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b18f2e-17dd-4067-a63a-032a2c421964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:12.972012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-02b18f2e-17dd-4067-a63a-032a2c421964 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:12.973231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-02b18f2e-17dd-4067-a63a-032a2c421964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:12.982069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 689/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:13.029209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da3a6f-33bd-4dd4-94ae-bae20887e6c3 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:13.044092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da3a6f-33bd-4dd4-94ae-bae20887e6c3 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:13.050063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3f01a-9e63-43ec-a604-979ab642e1e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:13.050759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f01a-9e63-43ec-a604-979ab642e1e8 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:13.051045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f01a-9e63-43ec-a604-979ab642e1e8 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:13.051353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3f01a-9e63-43ec-a604-979ab642e1e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:13.059687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3f01a-9e63-43ec-a604-979ab642e1e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:13.061333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3f01a-9e63-43ec-a604-979ab642e1e8 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:13.071617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 705/1394] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:14.068054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de967c94-62f5-45b9-b02c-e51ce28c82d2 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:14.068640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de967c94-62f5-45b9-b02c-e51ce28c82d2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:14.068640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de967c94-62f5-45b9-b02c-e51ce28c82d2 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:14.070034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 690/1395] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:14.075593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0711bf-1af5-438a-ae47-f1a3480fc27c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:14.075989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0711bf-1af5-438a-ae47-f1a3480fc27c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:14.076194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0711bf-1af5-438a-ae47-f1a3480fc27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:14.082203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=52 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:48:14.095169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-2a0711bf-1af5-438a-ae47-f1a3480fc27c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:14.096370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2a0711bf-1af5-438a-ae47-f1a3480fc27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:14.105061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 706/1396] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:14.160815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e18a-9d50-409b-933c-c1c1347a40f2 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:14.161178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e18a-9d50-409b-933c-c1c1347a40f2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:14.161561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e18a-9d50-409b-933c-c1c1347a40f2 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:14.163072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 691/1397] 10.222.0.59 () {54 vars in 962 bytes} [Wed May 18 14:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:14.168619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd769f-ad0c-44be-b865-95f9e715f1f2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:14.168962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd769f-ad0c-44be-b865-95f9e715f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:14.169252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd769f-ad0c-44be-b865-95f9e715f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:14.222789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-64dd769f-ad0c-44be-b865-95f9e715f1f2 None None] MFA Rules not processed for user `420ae644ec5548fbbde64ffa63c868ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:14.224130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-64dd769f-ad0c-44be-b865-95f9e715f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:14.284793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 707/1398] 10.222.0.59 () {58 vars in 1059 bytes} [Wed May 18 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:14.292266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e18a-9d50-409b-933c-c1c1347a40f2 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:14.303749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e18a-9d50-409b-933c-c1c1347a40f2 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:14.307346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1accb-6fab-4a75-94ea-5e98ff917a1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:14.307989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1accb-6fab-4a75-94ea-5e98ff917a1f service glance] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:14.308275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1accb-6fab-4a75-94ea-5e98ff917a1f service glance] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:14.308555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1accb-6fab-4a75-94ea-5e98ff917a1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:14.318552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1accb-6fab-4a75-94ea-5e98ff917a1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:14.319937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1accb-6fab-4a75-94ea-5e98ff917a1f service glance] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:14.330067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 692/1399] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:14.857617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac5533-9f44-4e15-a48e-b30f080b7dcb None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:14.857994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac5533-9f44-4e15-a48e-b30f080b7dcb None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:14.858350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac5533-9f44-4e15-a48e-b30f080b7dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:14.907537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5bac5533-9f44-4e15-a48e-b30f080b7dcb None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:14.908778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5bac5533-9f44-4e15-a48e-b30f080b7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:14.973356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 708/1400] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:15.019928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fdcc0-ff7f-4953-a89b-64c4835659bd None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:15.020295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fdcc0-ff7f-4953-a89b-64c4835659bd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:15.020684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fdcc0-ff7f-4953-a89b-64c4835659bd None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:15.022272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 693/1401] 10.222.0.59 () {54 vars in 942 bytes} [Wed May 18 14:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:15.029316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f22d3-3841-49b1-b325-bd516abaa563 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:15.029613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f22d3-3841-49b1-b325-bd516abaa563 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:15.029901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f22d3-3841-49b1-b325-bd516abaa563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:15.077173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-bd0f22d3-3841-49b1-b325-bd516abaa563 None None] MFA Rules not processed for user `f2c1ef0b6b3241a19397b8696c05fc99`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:15.078383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bd0f22d3-3841-49b1-b325-bd516abaa563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:15.092431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:48:15.154148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 709/1402] 10.222.0.59 () {58 vars in 1039 bytes} [Wed May 18 14:48:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:15.163607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fdcc0-ff7f-4953-a89b-64c4835659bd None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:15.178124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fdcc0-ff7f-4953-a89b-64c4835659bd None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:15.183035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324f75a-e5f0-40ff-9385-7fff20db8aec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:15.183681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f75a-e5f0-40ff-9385-7fff20db8aec service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:15.183985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f75a-e5f0-40ff-9385-7fff20db8aec service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:15.184248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f75a-e5f0-40ff-9385-7fff20db8aec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:15.195049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324f75a-e5f0-40ff-9385-7fff20db8aec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:15.196672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324f75a-e5f0-40ff-9385-7fff20db8aec service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:15.204882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 694/1403] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:48:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:48:15.315971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f5225-4e1e-416b-8a68-356bb12ef8a8 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:15.316260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f5225-4e1e-416b-8a68-356bb12ef8a8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:15.316544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f5225-4e1e-416b-8a68-356bb12ef8a8 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:15.317954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 710/1404] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:15.323402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407003f-d577-44cc-8c97-53a525ac63b5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:15.323875 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407003f-d577-44cc-8c97-53a525ac63b5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:15.324370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407003f-d577-44cc-8c97-53a525ac63b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:15.342584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-6407003f-d577-44cc-8c97-53a525ac63b5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:15.343777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6407003f-d577-44cc-8c97-53a525ac63b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:15.353417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 695/1405] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:15.397146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f5225-4e1e-416b-8a68-356bb12ef8a8 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:15.416443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f5225-4e1e-416b-8a68-356bb12ef8a8 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:15.423142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbdfa2-4857-4844-b2d7-28a85a4db7c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:15.423913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbdfa2-4857-4844-b2d7-28a85a4db7c7 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:15.424202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbdfa2-4857-4844-b2d7-28a85a4db7c7 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:15.424478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbdfa2-4857-4844-b2d7-28a85a4db7c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:15.433238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbdfa2-4857-4844-b2d7-28a85a4db7c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:15.434883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbdfa2-4857-4844-b2d7-28a85a4db7c7 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:15.446345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 711/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:17.790039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e5707-0a14-468e-99ea-5317d01c57b2 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:17.791127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e5707-0a14-468e-99ea-5317d01c57b2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:17.791540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e5707-0a14-468e-99ea-5317d01c57b2 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:17.793620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 696/1407] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:48:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:17.799368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e3f6c-3ce4-4d28-9d24-42bddaf5616d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:17.799813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e3f6c-3ce4-4d28-9d24-42bddaf5616d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:17.799998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e3f6c-3ce4-4d28-9d24-42bddaf5616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:17.818179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-196e3f6c-3ce4-4d28-9d24-42bddaf5616d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:17.819389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-196e3f6c-3ce4-4d28-9d24-42bddaf5616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:17.827403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 712/1408] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:17.872534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e5707-0a14-468e-99ea-5317d01c57b2 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:17.888260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e5707-0a14-468e-99ea-5317d01c57b2 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:17.894024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25545c6-cd8b-431c-ad13-108fb117f75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:17.894771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25545c6-cd8b-431c-ad13-108fb117f75b service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:17.895232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25545c6-cd8b-431c-ad13-108fb117f75b service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:17.895588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25545c6-cd8b-431c-ad13-108fb117f75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:17.905693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25545c6-cd8b-431c-ad13-108fb117f75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:17.907445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25545c6-cd8b-431c-ad13-108fb117f75b service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:17.921992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 697/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:27.813763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=33 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:48:28.218340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=43 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:48:39.080530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354f965-611f-4982-8289-397d8926cf15 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:39.081121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354f965-611f-4982-8289-397d8926cf15 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:39.081121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354f965-611f-4982-8289-397d8926cf15 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:39.082487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 713/1410] 10.222.0.59 () {54 vars in 918 bytes} [Wed May 18 14:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:39.087593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d187-adb7-4422-8d25-fcd66e626ef3 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:39.088032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d187-adb7-4422-8d25-fcd66e626ef3 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:39.088156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d187-adb7-4422-8d25-fcd66e626ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:39.105886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5d85d187-adb7-4422-8d25-fcd66e626ef3 None None] MFA Rules not processed for user `c316d4242edf4c82afd982127603827c`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:39.107072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5d85d187-adb7-4422-8d25-fcd66e626ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:39.115464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 698/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Wed May 18 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:39.129911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24bd2d-c4b6-4fce-8fdc-ddca0d89cb10 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:39.130202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24bd2d-c4b6-4fce-8fdc-ddca0d89cb10 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:39.130484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24bd2d-c4b6-4fce-8fdc-ddca0d89cb10 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:39.131893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 714/1412] 10.222.0.59 () {54 vars in 918 bytes} [Wed May 18 14:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:39.136959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd268b54-be02-49a2-8fe6-2a38ae324fc7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:39.137256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd268b54-be02-49a2-8fe6-2a38ae324fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:39.137566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd268b54-be02-49a2-8fe6-2a38ae324fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:39.155143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-dd268b54-be02-49a2-8fe6-2a38ae324fc7 None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:39.156325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dd268b54-be02-49a2-8fe6-2a38ae324fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:39.165531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 699/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Wed May 18 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:41.901141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4472dd0-f584-4bd6-9375-1c8a42462f99 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:41.901735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4472dd0-f584-4bd6-9375-1c8a42462f99 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:41.901735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4472dd0-f584-4bd6-9375-1c8a42462f99 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:41.903090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:41.908277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf20acb-1b9e-42d2-80eb-7db43eb68266 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:41.908666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf20acb-1b9e-42d2-80eb-7db43eb68266 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:41.908855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf20acb-1b9e-42d2-80eb-7db43eb68266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:41.927105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-baf20acb-1b9e-42d2-80eb-7db43eb68266 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:41.928279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-baf20acb-1b9e-42d2-80eb-7db43eb68266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:41.936549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:41.977710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4472dd0-f584-4bd6-9375-1c8a42462f99 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:41.994236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4472dd0-f584-4bd6-9375-1c8a42462f99 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:42.000107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd503-6469-48d8-81e0-967bb182a2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:42.000766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd503-6469-48d8-81e0-967bb182a2e6 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:42.001050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd503-6469-48d8-81e0-967bb182a2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:42.001328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd503-6469-48d8-81e0-967bb182a2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:42.009439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd503-6469-48d8-81e0-967bb182a2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:42.011084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd503-6469-48d8-81e0-967bb182a2e6 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:42.023096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 716/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:43.015057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316376c-f4d7-44f4-a4f4-993d13cfa685 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:43.015676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316376c-f4d7-44f4-a4f4-993d13cfa685 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:43.015676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316376c-f4d7-44f4-a4f4-993d13cfa685 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:43.018134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:43.023594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1923a-353f-45f4-ba0c-4b0b29050fdd None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:43.024033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1923a-353f-45f4-ba0c-4b0b29050fdd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:43.024140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1923a-353f-45f4-ba0c-4b0b29050fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:43.045130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-2bb1923a-353f-45f4-ba0c-4b0b29050fdd None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:43.046641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2bb1923a-353f-45f4-ba0c-4b0b29050fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:43.054681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:43.219563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316376c-f4d7-44f4-a4f4-993d13cfa685 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:43.234312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316376c-f4d7-44f4-a4f4-993d13cfa685 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:43.239711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c122-eb73-41fc-85f4-ff4a01f1efef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:43.240349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c122-eb73-41fc-85f4-ff4a01f1efef service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:43.240673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c122-eb73-41fc-85f4-ff4a01f1efef service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:43.240956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c122-eb73-41fc-85f4-ff4a01f1efef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:43.249640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c122-eb73-41fc-85f4-ff4a01f1efef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:43.251233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c122-eb73-41fc-85f4-ff4a01f1efef service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:43.260571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 702/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:44.196214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ceebfa-31d2-4004-a472-ace6252a8931 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:44.196791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ceebfa-31d2-4004-a472-ace6252a8931 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:44.196791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ceebfa-31d2-4004-a472-ace6252a8931 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:44.198676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:44.203626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8cc89-90dc-4ab6-ae2d-c4a6257d34c2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:44.204042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8cc89-90dc-4ab6-ae2d-c4a6257d34c2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:44.204189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8cc89-90dc-4ab6-ae2d-c4a6257d34c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:44.222782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-adb8cc89-90dc-4ab6-ae2d-c4a6257d34c2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:44.223985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-adb8cc89-90dc-4ab6-ae2d-c4a6257d34c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:44.231874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:48:44.379859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ceebfa-31d2-4004-a472-ace6252a8931 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:44.394353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ceebfa-31d2-4004-a472-ace6252a8931 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:44.399943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0fc4c-ee38-44c6-996b-1b896c34847e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:44.400800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fc4c-ee38-44c6-996b-1b896c34847e service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:44.401180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fc4c-ee38-44c6-996b-1b896c34847e service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:44.401597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0fc4c-ee38-44c6-996b-1b896c34847e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:44.410323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0fc4c-ee38-44c6-996b-1b896c34847e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:44.411945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0fc4c-ee38-44c6-996b-1b896c34847e service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:44.421932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 719/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:45.341396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4c720-b095-46a1-96f9-5b3fce777d7d None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:45.341959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4c720-b095-46a1-96f9-5b3fce777d7d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:45.341959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4c720-b095-46a1-96f9-5b3fce777d7d None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:45.343434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:45.348251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98be6f-d027-4441-96f8-f3ab183091e7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:45.348693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98be6f-d027-4441-96f8-f3ab183091e7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:45.348837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98be6f-d027-4441-96f8-f3ab183091e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:45.368719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7e98be6f-d027-4441-96f8-f3ab183091e7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:45.369942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7e98be6f-d027-4441-96f8-f3ab183091e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:45.378651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:45.525498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4c720-b095-46a1-96f9-5b3fce777d7d None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:45.540350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4c720-b095-46a1-96f9-5b3fce777d7d None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:45.545778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf8ffe-88f1-4f06-a98c-c6d38b387e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:45.546668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf8ffe-88f1-4f06-a98c-c6d38b387e1f service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:45.546947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf8ffe-88f1-4f06-a98c-c6d38b387e1f service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:45.547240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf8ffe-88f1-4f06-a98c-c6d38b387e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:45.555188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf8ffe-88f1-4f06-a98c-c6d38b387e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:45.556790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf8ffe-88f1-4f06-a98c-c6d38b387e1f service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:45.565894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 705/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:46.476259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220200aa-c252-4c99-9142-4671d34a207d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:46.476793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220200aa-c252-4c99-9142-4671d34a207d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:46.476793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220200aa-c252-4c99-9142-4671d34a207d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:46.478501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:46.482946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e451514-532d-4370-a6f9-f29f530f52d0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:46.483410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e451514-532d-4370-a6f9-f29f530f52d0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:46.483512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e451514-532d-4370-a6f9-f29f530f52d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:46.502449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2e451514-532d-4370-a6f9-f29f530f52d0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:46.503650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2e451514-532d-4370-a6f9-f29f530f52d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:46.513211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:46.662575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220200aa-c252-4c99-9142-4671d34a207d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:46.677631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220200aa-c252-4c99-9142-4671d34a207d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:46.683761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c6474-6fb6-4270-b2a4-da1d90312973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:46.684406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c6474-6fb6-4270-b2a4-da1d90312973 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:46.684726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c6474-6fb6-4270-b2a4-da1d90312973 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:46.685012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c6474-6fb6-4270-b2a4-da1d90312973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:46.693333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c6474-6fb6-4270-b2a4-da1d90312973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:46.694915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c6474-6fb6-4270-b2a4-da1d90312973 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:46.705999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 722/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:47.584185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd2f38-2f81-4a09-ac87-6211b5b04c61 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:47.584755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd2f38-2f81-4a09-ac87-6211b5b04c61 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:47.584877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd2f38-2f81-4a09-ac87-6211b5b04c61 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:47.586164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:47.591006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a466d63-f862-4b54-a93b-ec79dce0f195 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:47.591382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a466d63-f862-4b54-a93b-ec79dce0f195 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:47.591575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a466d63-f862-4b54-a93b-ec79dce0f195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:47.609513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-2a466d63-f862-4b54-a93b-ec79dce0f195 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:47.610700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2a466d63-f862-4b54-a93b-ec79dce0f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:47.618443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:47.768116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd2f38-2f81-4a09-ac87-6211b5b04c61 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:47.782346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd2f38-2f81-4a09-ac87-6211b5b04c61 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:47.787704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40478c3-182b-45fd-835b-14ea837a36c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:47.788336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40478c3-182b-45fd-835b-14ea837a36c1 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:47.788652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40478c3-182b-45fd-835b-14ea837a36c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:47.788935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40478c3-182b-45fd-835b-14ea837a36c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:47.797670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40478c3-182b-45fd-835b-14ea837a36c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:47.799263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40478c3-182b-45fd-835b-14ea837a36c1 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:47.809055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 708/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:48.672143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17126404-7466-468c-946c-48763e8d4d06 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:48.672695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17126404-7466-468c-946c-48763e8d4d06 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:48.672695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17126404-7466-468c-946c-48763e8d4d06 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:48.674047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:48.678943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4fee-0c96-4d61-b06a-2bd83a80139e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:48.679374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4fee-0c96-4d61-b06a-2bd83a80139e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:48.679511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb4fee-0c96-4d61-b06a-2bd83a80139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:48.697819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-35cb4fee-0c96-4d61-b06a-2bd83a80139e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:48.699051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-35cb4fee-0c96-4d61-b06a-2bd83a80139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:48.706801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:48.855727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17126404-7466-468c-946c-48763e8d4d06 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:48.869960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17126404-7466-468c-946c-48763e8d4d06 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:48.875395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b891-abc5-406e-8816-05c276ed5e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:48.876027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b891-abc5-406e-8816-05c276ed5e3b service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:48.876314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b891-abc5-406e-8816-05c276ed5e3b service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:48.876611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b891-abc5-406e-8816-05c276ed5e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:48.884543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01b891-abc5-406e-8816-05c276ed5e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:48.886156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01b891-abc5-406e-8816-05c276ed5e3b service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:48.895324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 725/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:49.774284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221eff-7f2e-49b7-aa17-0aea233a27eb None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:49.774854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221eff-7f2e-49b7-aa17-0aea233a27eb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:49.774854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221eff-7f2e-49b7-aa17-0aea233a27eb None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:49.776235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:49.781356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439176c-0f10-4423-a0be-6a12e7c8f08c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:49.781778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439176c-0f10-4423-a0be-6a12e7c8f08c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:49.781953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439176c-0f10-4423-a0be-6a12e7c8f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:49.800095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9439176c-0f10-4423-a0be-6a12e7c8f08c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:49.801319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9439176c-0f10-4423-a0be-6a12e7c8f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:49.809702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:49.958626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221eff-7f2e-49b7-aa17-0aea233a27eb None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:49.973188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221eff-7f2e-49b7-aa17-0aea233a27eb None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:49.978586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b89efe-89d3-4ab2-96fc-3a3f0a70e792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:49.979709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89efe-89d3-4ab2-96fc-3a3f0a70e792 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:49.979996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89efe-89d3-4ab2-96fc-3a3f0a70e792 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:49.980267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89efe-89d3-4ab2-96fc-3a3f0a70e792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:49.989303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b89efe-89d3-4ab2-96fc-3a3f0a70e792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:49.990886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b89efe-89d3-4ab2-96fc-3a3f0a70e792 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:50.000995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 711/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:50.867265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865531f-8388-4dc1-99ca-27878bbde858 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:50.867817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865531f-8388-4dc1-99ca-27878bbde858 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:50.867817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865531f-8388-4dc1-99ca-27878bbde858 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:50.869279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:50.874115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bf4f8-fe83-42f8-aa1c-87fef1f92674 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:50.874530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bf4f8-fe83-42f8-aa1c-87fef1f92674 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:50.874682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bf4f8-fe83-42f8-aa1c-87fef1f92674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:50.893925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-3d2bf4f8-fe83-42f8-aa1c-87fef1f92674 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:50.895123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-3d2bf4f8-fe83-42f8-aa1c-87fef1f92674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:50.903845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:51.054270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865531f-8388-4dc1-99ca-27878bbde858 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:51.069062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865531f-8388-4dc1-99ca-27878bbde858 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:51.075134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68566d-c897-470c-9030-4a87b0535339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:51.075771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68566d-c897-470c-9030-4a87b0535339 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:51.076059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68566d-c897-470c-9030-4a87b0535339 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:51.076343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68566d-c897-470c-9030-4a87b0535339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:51.084404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68566d-c897-470c-9030-4a87b0535339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:51.086013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68566d-c897-470c-9030-4a87b0535339 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:51.096898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 728/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:53.247407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276fb2f-1f1a-4383-bb11-5294fd8d1e9a None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:53.247939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276fb2f-1f1a-4383-bb11-5294fd8d1e9a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:53.247939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276fb2f-1f1a-4383-bb11-5294fd8d1e9a None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:53.249405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:53.254748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b569-84c4-44dc-bcee-60e09b481f22 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:53.255166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b569-84c4-44dc-bcee-60e09b481f22 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:53.255321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b569-84c4-44dc-bcee-60e09b481f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:53.274268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e575b569-84c4-44dc-bcee-60e09b481f22 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:53.275479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e575b569-84c4-44dc-bcee-60e09b481f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:53.285067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:53.324609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276fb2f-1f1a-4383-bb11-5294fd8d1e9a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:53.335429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276fb2f-1f1a-4383-bb11-5294fd8d1e9a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:53.339582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0f3a-e81d-4039-a74e-d6788beec49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:53.340219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0f3a-e81d-4039-a74e-d6788beec49e service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:53.340499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0f3a-e81d-4039-a74e-d6788beec49e service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:53.340813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0f3a-e81d-4039-a74e-d6788beec49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:53.350027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae0f3a-e81d-4039-a74e-d6788beec49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:53.351458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae0f3a-e81d-4039-a74e-d6788beec49e service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:53.361301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 714/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:55.712955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9e19d-26e1-4e3a-b8f3-55661c55aa4d None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:55.714031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9e19d-26e1-4e3a-b8f3-55661c55aa4d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:55.714031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9e19d-26e1-4e3a-b8f3-55661c55aa4d None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:55.715395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:55.720682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc137-43f1-4eb3-81c1-f8a1fa037eb9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:55.721148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc137-43f1-4eb3-81c1-f8a1fa037eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:55.721257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc137-43f1-4eb3-81c1-f8a1fa037eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:55.740007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a71cc137-43f1-4eb3-81c1-f8a1fa037eb9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:55.741238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a71cc137-43f1-4eb3-81c1-f8a1fa037eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:55.748948 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:48:55.785631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9e19d-26e1-4e3a-b8f3-55661c55aa4d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:55.797114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9e19d-26e1-4e3a-b8f3-55661c55aa4d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:55.800667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8ba4a-a80d-4fa4-8e5d-1802d5d628b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:55.801302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ba4a-a80d-4fa4-8e5d-1802d5d628b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:55.801593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ba4a-a80d-4fa4-8e5d-1802d5d628b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:55.801880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8ba4a-a80d-4fa4-8e5d-1802d5d628b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:55.810790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8ba4a-a80d-4fa4-8e5d-1802d5d628b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:55.812219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8ba4a-a80d-4fa4-8e5d-1802d5d628b0 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:55.821802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 731/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:48:58.340457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49af8f-d844-440f-afe1-28291b3f9cd9 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:58.341038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49af8f-d844-440f-afe1-28291b3f9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:58.341038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49af8f-d844-440f-afe1-28291b3f9cd9 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:58.342407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:48:58.347586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cfc0-4481-44b2-9531-c61a98b40e69 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:58.348025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cfc0-4481-44b2-9531-c61a98b40e69 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:58.348147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cfc0-4481-44b2-9531-c61a98b40e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:58.366814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-94b4cfc0-4481-44b2-9531-c61a98b40e69 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:48:58.367995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-94b4cfc0-4481-44b2-9531-c61a98b40e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:48:58.376330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:48:58.413420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49af8f-d844-440f-afe1-28291b3f9cd9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:48:58.424952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49af8f-d844-440f-afe1-28291b3f9cd9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:48:58.428420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7dbe8-2467-4340-b9d3-89a874dbd746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:48:58.429080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7dbe8-2467-4340-b9d3-89a874dbd746 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:48:58.429363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7dbe8-2467-4340-b9d3-89a874dbd746 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:48:58.429642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7dbe8-2467-4340-b9d3-89a874dbd746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:48:58.439542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7dbe8-2467-4340-b9d3-89a874dbd746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:48:58.441005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7dbe8-2467-4340-b9d3-89a874dbd746 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:48:58.450071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 717/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:00.796695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35821c-1940-4837-911c-c67242f03ea4 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:00.797289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35821c-1940-4837-911c-c67242f03ea4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:00.797289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35821c-1940-4837-911c-c67242f03ea4 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:00.798630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:00.804042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38dde2-6a65-4a85-9716-e92c5921cc86 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:00.804457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38dde2-6a65-4a85-9716-e92c5921cc86 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:00.804616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38dde2-6a65-4a85-9716-e92c5921cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:00.822240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-4a38dde2-6a65-4a85-9716-e92c5921cc86 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:00.823409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4a38dde2-6a65-4a85-9716-e92c5921cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:00.831130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:00.868445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35821c-1940-4837-911c-c67242f03ea4 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:00.879032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35821c-1940-4837-911c-c67242f03ea4 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:00.882542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fc1b-5b1e-4a17-8e18-a28a1cd39ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:00.883162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fc1b-5b1e-4a17-8e18-a28a1cd39ddc service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:00.883449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fc1b-5b1e-4a17-8e18-a28a1cd39ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:00.883730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fc1b-5b1e-4a17-8e18-a28a1cd39ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:00.892486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32fc1b-5b1e-4a17-8e18-a28a1cd39ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:00.893935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32fc1b-5b1e-4a17-8e18-a28a1cd39ddc service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:00.903640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 734/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:03.177260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8731f-1be7-4ea2-a033-eaac42bc8c22 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:03.177780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8731f-1be7-4ea2-a033-eaac42bc8c22 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:03.177898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8731f-1be7-4ea2-a033-eaac42bc8c22 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:03.179198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:03.185066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcfaf-2dd7-49cf-b3c3-0b1880f26cf0 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:03.185504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcfaf-2dd7-49cf-b3c3-0b1880f26cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:03.185614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcfaf-2dd7-49cf-b3c3-0b1880f26cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:03.204182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9f2fcfaf-2dd7-49cf-b3c3-0b1880f26cf0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:03.205466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9f2fcfaf-2dd7-49cf-b3c3-0b1880f26cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:03.213506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:03.250135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8731f-1be7-4ea2-a033-eaac42bc8c22 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:03.261448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8731f-1be7-4ea2-a033-eaac42bc8c22 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:03.265001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba745f-761f-4ad5-896b-4533c4feef44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:03.265637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba745f-761f-4ad5-896b-4533c4feef44 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:03.265924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba745f-761f-4ad5-896b-4533c4feef44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:03.266206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba745f-761f-4ad5-896b-4533c4feef44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:03.275002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba745f-761f-4ad5-896b-4533c4feef44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:03.276434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba745f-761f-4ad5-896b-4533c4feef44 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:03.285952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 720/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:05.542330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90e03-8a22-46fd-aae0-0c536901f371 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:05.542866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90e03-8a22-46fd-aae0-0c536901f371 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:05.542989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90e03-8a22-46fd-aae0-0c536901f371 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:05.544278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:05.549905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284946ac-20b1-404f-954b-65a34c9b9d1a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:05.550344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284946ac-20b1-404f-954b-65a34c9b9d1a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:05.550451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284946ac-20b1-404f-954b-65a34c9b9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:05.568372 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-284946ac-20b1-404f-954b-65a34c9b9d1a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:05.569631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-284946ac-20b1-404f-954b-65a34c9b9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:05.578025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:05.617628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90e03-8a22-46fd-aae0-0c536901f371 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:05.628542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90e03-8a22-46fd-aae0-0c536901f371 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:05.632000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d228001-7b49-420f-8f8a-0f45224a265a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:05.632687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d228001-7b49-420f-8f8a-0f45224a265a service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:05.632972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d228001-7b49-420f-8f8a-0f45224a265a service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:05.633250 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d228001-7b49-420f-8f8a-0f45224a265a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:05.642458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d228001-7b49-420f-8f8a-0f45224a265a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:05.643869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d228001-7b49-420f-8f8a-0f45224a265a service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:05.652885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 737/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:07.894192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e0b9-d091-4ac1-a38c-fe22ba3e4cf3 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:07.894728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e0b9-d091-4ac1-a38c-fe22ba3e4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:07.894849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02e0b9-d091-4ac1-a38c-fe22ba3e4cf3 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:07.896135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:07.901453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a4ec-7b0b-40b1-ac12-93a85b873bc6 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:07.901874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a4ec-7b0b-40b1-ac12-93a85b873bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:07.902009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a4ec-7b0b-40b1-ac12-93a85b873bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:07.920251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-27d3a4ec-7b0b-40b1-ac12-93a85b873bc6 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:07.921729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-27d3a4ec-7b0b-40b1-ac12-93a85b873bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:07.929419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:49:07.965747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02e0b9-d091-4ac1-a38c-fe22ba3e4cf3 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:07.976438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02e0b9-d091-4ac1-a38c-fe22ba3e4cf3 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:07.980572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5e1f7-ea83-469b-8ba5-a0c5e48ddee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:07.981233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e1f7-ea83-469b-8ba5-a0c5e48ddee7 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:07.981518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e1f7-ea83-469b-8ba5-a0c5e48ddee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:07.981797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e1f7-ea83-469b-8ba5-a0c5e48ddee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:07.991152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5e1f7-ea83-469b-8ba5-a0c5e48ddee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:07.992602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5e1f7-ea83-469b-8ba5-a0c5e48ddee7 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:08.002447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 723/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:10.265276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6f95-3e10-4414-88b1-e05a6d296714 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:10.265813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6f95-3e10-4414-88b1-e05a6d296714 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:10.265813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6f95-3e10-4414-88b1-e05a6d296714 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:10.267209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:10.272397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28138-79ad-441d-bb5a-a467e58eff56 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:10.272867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28138-79ad-441d-bb5a-a467e58eff56 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:10.273014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28138-79ad-441d-bb5a-a467e58eff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:10.279175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=79 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:49:10.292081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c0b28138-79ad-441d-bb5a-a467e58eff56 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:10.293368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c0b28138-79ad-441d-bb5a-a467e58eff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:10.301428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:10.339071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6f95-3e10-4414-88b1-e05a6d296714 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:10.344320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=73 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:49:10.350590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6f95-3e10-4414-88b1-e05a6d296714 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:10.354101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd0588-9184-4801-8fc5-5582050d27f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:10.354720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd0588-9184-4801-8fc5-5582050d27f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:10.355003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd0588-9184-4801-8fc5-5582050d27f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:10.355277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd0588-9184-4801-8fc5-5582050d27f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:10.363938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd0588-9184-4801-8fc5-5582050d27f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:10.365384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd0588-9184-4801-8fc5-5582050d27f9 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:10.374507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 740/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:12.614097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043b650-9db7-46b5-9aa1-be6ca5edd636 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:12.614650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043b650-9db7-46b5-9aa1-be6ca5edd636 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:12.614650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043b650-9db7-46b5-9aa1-be6ca5edd636 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:12.615929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:12.621328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48c0e-f8ef-4b5f-b895-bcdaff037b1f None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:12.621751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48c0e-f8ef-4b5f-b895-bcdaff037b1f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:12.621909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48c0e-f8ef-4b5f-b895-bcdaff037b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:12.639920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b8b48c0e-f8ef-4b5f-b895-bcdaff037b1f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:12.641145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b8b48c0e-f8ef-4b5f-b895-bcdaff037b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:12.648900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:12.693406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043b650-9db7-46b5-9aa1-be6ca5edd636 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:12.704778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043b650-9db7-46b5-9aa1-be6ca5edd636 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:12.708449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215c566-ac9d-4af8-91e6-6dffb7c45d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:12.709124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215c566-ac9d-4af8-91e6-6dffb7c45d62 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:12.709435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215c566-ac9d-4af8-91e6-6dffb7c45d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:12.709715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215c566-ac9d-4af8-91e6-6dffb7c45d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:12.719264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215c566-ac9d-4af8-91e6-6dffb7c45d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:12.720728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215c566-ac9d-4af8-91e6-6dffb7c45d62 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:12.730594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 726/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:14.940287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52136e-07d8-4420-b4f4-36abb5db4881 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:14.940872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52136e-07d8-4420-b4f4-36abb5db4881 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:14.940872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52136e-07d8-4420-b4f4-36abb5db4881 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:14.942280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:14.948002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd6ca-4592-43ca-b00f-07ba071bdda6 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:14.948402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd6ca-4592-43ca-b00f-07ba071bdda6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:14.948567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bd6ca-4592-43ca-b00f-07ba071bdda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:14.966533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-313bd6ca-4592-43ca-b00f-07ba071bdda6 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:14.967716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-313bd6ca-4592-43ca-b00f-07ba071bdda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:14.975486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:15.010682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52136e-07d8-4420-b4f4-36abb5db4881 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:15.021267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52136e-07d8-4420-b4f4-36abb5db4881 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:15.024828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a49ad7-81c0-4baf-be41-8d53c4c42ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:15.026062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49ad7-81c0-4baf-be41-8d53c4c42ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:15.026352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49ad7-81c0-4baf-be41-8d53c4c42ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:15.026633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49ad7-81c0-4baf-be41-8d53c4c42ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:15.035498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a49ad7-81c0-4baf-be41-8d53c4c42ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:15.036970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a49ad7-81c0-4baf-be41-8d53c4c42ea7 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:15.046489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 743/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:24.960833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=11 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:49:25.042162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=14 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:49:48.047820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2b59-f9fc-4081-b917-c2bbfa62b6f2 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:48.048416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2b59-f9fc-4081-b917-c2bbfa62b6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:48.048416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc2b59-f9fc-4081-b917-c2bbfa62b6f2 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:48.049817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 728/1471] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:48.054817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55f7c-b192-4445-82ee-535dceb4f4ac None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:48.055245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55f7c-b192-4445-82ee-535dceb4f4ac None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:48.055426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55f7c-b192-4445-82ee-535dceb4f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:48.072967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c6f55f7c-b192-4445-82ee-535dceb4f4ac None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:48.074164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c6f55f7c-b192-4445-82ee-535dceb4f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:48.081901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 744/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:48.128553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7888-6ab0-480a-a0be-cf3eb6e0dec1 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:48.128882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7888-6ab0-480a-a0be-cf3eb6e0dec1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:48.129166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7888-6ab0-480a-a0be-cf3eb6e0dec1 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:48.130519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 729/1473] 10.222.0.59 () {54 vars in 962 bytes} [Wed May 18 14:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:48.135096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b096fb7-2643-4f62-9e21-cd7465522672 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:48.135389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b096fb7-2643-4f62-9e21-cd7465522672 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:48.135673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b096fb7-2643-4f62-9e21-cd7465522672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:48.153644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7b096fb7-2643-4f62-9e21-cd7465522672 None None] MFA Rules not processed for user `420ae644ec5548fbbde64ffa63c868ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:48.154813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7b096fb7-2643-4f62-9e21-cd7465522672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:48.161110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 745/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Wed May 18 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:48.168446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7888-6ab0-480a-a0be-cf3eb6e0dec1 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:48.179085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7888-6ab0-480a-a0be-cf3eb6e0dec1 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:48.182672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88813-a3dc-4723-810a-f8ca339ec116 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:48.183288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88813-a3dc-4723-810a-f8ca339ec116 service glance] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:48.183574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88813-a3dc-4723-810a-f8ca339ec116 service glance] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:48.183853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88813-a3dc-4723-810a-f8ca339ec116 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:48.192924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88813-a3dc-4723-810a-f8ca339ec116 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:48.194361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88813-a3dc-4723-810a-f8ca339ec116 service glance] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:48.203911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 730/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:49:50.554491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4516d-19e0-4ef2-b4a2-d45006c0e657 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:50.555013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4516d-19e0-4ef2-b4a2-d45006c0e657 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:50.555146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4516d-19e0-4ef2-b4a2-d45006c0e657 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:50.557260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 746/1476] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:50.562582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4152815-1c7f-464a-99a8-1909533ca165 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:50.562978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4152815-1c7f-464a-99a8-1909533ca165 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:50.563171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4152815-1c7f-464a-99a8-1909533ca165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:50.581320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c4152815-1c7f-464a-99a8-1909533ca165 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:50.582553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c4152815-1c7f-464a-99a8-1909533ca165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:50.590531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 731/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:50.613553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4516d-19e0-4ef2-b4a2-d45006c0e657 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:50.626359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4516d-19e0-4ef2-b4a2-d45006c0e657 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:50.630816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a13eb-7b78-45a9-af7e-729c214c309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:50.631460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a13eb-7b78-45a9-af7e-729c214c309c admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:50.631749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a13eb-7b78-45a9-af7e-729c214c309c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:50.632035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a13eb-7b78-45a9-af7e-729c214c309c admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:50.632849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a13eb-7b78-45a9-af7e-729c214c309c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:50.635252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-790a13eb-7b78-45a9-af7e-729c214c309c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:49:50.635252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:49:50.635252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:49:50.636386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a13eb-7b78-45a9-af7e-729c214c309c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:50.655169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 747/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 18 14:49:50 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:49:52.878304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee06f4-3484-40e5-a2bf-c04a7ff50abc None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:52.878854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee06f4-3484-40e5-a2bf-c04a7ff50abc None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:52.878854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee06f4-3484-40e5-a2bf-c04a7ff50abc None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:52.880205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 732/1479] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:52.886248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ae1b-4334-4df3-b6ac-792cfbf5041e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:52.886702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ae1b-4334-4df3-b6ac-792cfbf5041e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:52.886822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ae1b-4334-4df3-b6ac-792cfbf5041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:52.906434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-35d0ae1b-4334-4df3-b6ac-792cfbf5041e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:52.907633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-35d0ae1b-4334-4df3-b6ac-792cfbf5041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:52.915472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 748/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:49:52.958957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee06f4-3484-40e5-a2bf-c04a7ff50abc None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:52.974028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee06f4-3484-40e5-a2bf-c04a7ff50abc None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:52.979373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557d289-7b75-4ef2-b1ad-fd39fed25e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:52.980014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d289-7b75-4ef2-b1ad-fd39fed25e11 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:52.980303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d289-7b75-4ef2-b1ad-fd39fed25e11 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:52.980605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d289-7b75-4ef2-b1ad-fd39fed25e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:52.989064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557d289-7b75-4ef2-b1ad-fd39fed25e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:52.990755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557d289-7b75-4ef2-b1ad-fd39fed25e11 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:53.000492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 733/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:55.382196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12722a-e53c-44b1-a44e-ed3b06056e95 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:55.382714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12722a-e53c-44b1-a44e-ed3b06056e95 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:55.382714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12722a-e53c-44b1-a44e-ed3b06056e95 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:55.384072 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 749/1482] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:55.389664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f43b-e8d3-40ee-8b8a-ab5fb53c9951 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:55.390084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f43b-e8d3-40ee-8b8a-ab5fb53c9951 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:55.390225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f43b-e8d3-40ee-8b8a-ab5fb53c9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:55.407830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2ca3f43b-e8d3-40ee-8b8a-ab5fb53c9951 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:55.409051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2ca3f43b-e8d3-40ee-8b8a-ab5fb53c9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:55.417454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 734/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:49:55.454466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12722a-e53c-44b1-a44e-ed3b06056e95 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:55.456206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ae12722a-e53c-44b1-a44e-ed3b06056e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:55.469609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12722a-e53c-44b1-a44e-ed3b06056e95 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:55.473135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e70354-0ad1-412e-be37-95b192fd5411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:55.473783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e70354-0ad1-412e-be37-95b192fd5411 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:55.474067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e70354-0ad1-412e-be37-95b192fd5411 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:55.474349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e70354-0ad1-412e-be37-95b192fd5411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:55.483633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e70354-0ad1-412e-be37-95b192fd5411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:55.485113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e70354-0ad1-412e-be37-95b192fd5411 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:55.495127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 750/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:49:57.758711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b52f-63f3-4d57-a192-29cfb0391b0f None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:57.759270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b52f-63f3-4d57-a192-29cfb0391b0f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:57.759270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b52f-63f3-4d57-a192-29cfb0391b0f None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:57.760654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 735/1485] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:49:57.765983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8f42-5b57-4f28-b951-ed5a645f0ffc None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:57.766399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8f42-5b57-4f28-b951-ed5a645f0ffc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:57.766553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8f42-5b57-4f28-b951-ed5a645f0ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:57.784680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-63db8f42-5b57-4f28-b951-ed5a645f0ffc None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:49:57.785873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-63db8f42-5b57-4f28-b951-ed5a645f0ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:49:57.793720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 751/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:49:57.832229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b52f-63f3-4d57-a192-29cfb0391b0f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:49:57.842657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b52f-63f3-4d57-a192-29cfb0391b0f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:49:57.846072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fff536-c9f9-46d2-9f56-b9006309b0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:49:57.846702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fff536-c9f9-46d2-9f56-b9006309b0bc service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:49:57.846984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fff536-c9f9-46d2-9f56-b9006309b0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:49:57.847264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fff536-c9f9-46d2-9f56-b9006309b0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:49:57.855928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fff536-c9f9-46d2-9f56-b9006309b0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:49:57.857384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fff536-c9f9-46d2-9f56-b9006309b0bc service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:49:57.866627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 736/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:50:00.368438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4763-10aa-49d3-b147-11246f3251e5 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:50:00.369061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4763-10aa-49d3-b147-11246f3251e5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:50:00.369061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4763-10aa-49d3-b147-11246f3251e5 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:50:00.370486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 752/1488] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:50:00.375763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e46a2-2f54-49a4-aa78-82cab85c37a6 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:50:00.376186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e46a2-2f54-49a4-aa78-82cab85c37a6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:50:00.376340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e46a2-2f54-49a4-aa78-82cab85c37a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:50:00.394263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d52e46a2-2f54-49a4-aa78-82cab85c37a6 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:50:00.395451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d52e46a2-2f54-49a4-aa78-82cab85c37a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:50:00.403809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 737/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:50:00.442238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4763-10aa-49d3-b147-11246f3251e5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:50:00.453429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4763-10aa-49d3-b147-11246f3251e5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:50:00.456930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8657c1f-592d-4f64-8039-bac8f365b18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:50:00.457560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8657c1f-592d-4f64-8039-bac8f365b18f service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:50:00.457845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8657c1f-592d-4f64-8039-bac8f365b18f service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:50:00.458122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8657c1f-592d-4f64-8039-bac8f365b18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:50:00.467439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8657c1f-592d-4f64-8039-bac8f365b18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:50:00.468858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8657c1f-592d-4f64-8039-bac8f365b18f service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:50:00.477963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 753/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:50:02.968153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d90bd-0306-4794-9fd8-291ecf1bc542 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:50:02.968798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d90bd-0306-4794-9fd8-291ecf1bc542 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:50:02.968798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d90bd-0306-4794-9fd8-291ecf1bc542 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:50:02.970213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 738/1491] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 18 14:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:50:02.975281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b885f1-6d41-48c1-9663-4a9ac4dae2d2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:50:02.975732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b885f1-6d41-48c1-9663-4a9ac4dae2d2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:50:02.975875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b885f1-6d41-48c1-9663-4a9ac4dae2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:50:02.993817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-83b885f1-6d41-48c1-9663-4a9ac4dae2d2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:50:02.995008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-83b885f1-6d41-48c1-9663-4a9ac4dae2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:50:03.002706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 754/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 18 14:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:50:03.040965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d90bd-0306-4794-9fd8-291ecf1bc542 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:50:03.051682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d90bd-0306-4794-9fd8-291ecf1bc542 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:50:03.055681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328e4c7-06d7-46f9-b8c4-decabb58b838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:50:03.056308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e4c7-06d7-46f9-b8c4-decabb58b838 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:50:03.056605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e4c7-06d7-46f9-b8c4-decabb58b838 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:50:03.056893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328e4c7-06d7-46f9-b8c4-decabb58b838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:50:03.065556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328e4c7-06d7-46f9-b8c4-decabb58b838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:50:03.066984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328e4c7-06d7-46f9-b8c4-decabb58b838 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:50:03.076722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 739/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:50:12.988286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=33 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:50:13.072676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=33 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:51:51.759684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3ed47-5934-4f51-8017-7da39bd3651e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:51.760270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3ed47-5934-4f51-8017-7da39bd3651e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:51.760270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3ed47-5934-4f51-8017-7da39bd3651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:51.777936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b6e3ed47-5934-4f51-8017-7da39bd3651e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:51:51.779137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b6e3ed47-5934-4f51-8017-7da39bd3651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:51:51.787229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 755/1494] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:51:51.796998 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c44a2-282e-488c-ba67-59e97303d57f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:51.797763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c44a2-282e-488c-ba67-59e97303d57f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:51.797880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c44a2-282e-488c-ba67-59e97303d57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:51.816029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d66c44a2-282e-488c-ba67-59e97303d57f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:51:51.817282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d66c44a2-282e-488c-ba67-59e97303d57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:51:51.825633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 740/1495] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:51:51.830096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3ed47-5934-4f51-8017-7da39bd3651e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:51.839675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3ed47-5934-4f51-8017-7da39bd3651e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:51.844139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:51.844823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:51.845111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:51.845393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:51.846110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:51:51.846421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:51.847433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:51.847433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:51:51.847433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:51:51.848316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:51.859932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 756/1496] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:51:51.868285 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c44a2-282e-488c-ba67-59e97303d57f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:51.877314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c44a2-282e-488c-ba67-59e97303d57f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:51.882550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:51.883198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:51.883509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:51.883791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:51.884486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:51.886295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING py.warnings [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:51.886295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: warnings.warn(msg) May 18 14:51:51.886295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: May 18 14:51:51.887497 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:51.922963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 741/1497] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:51:51 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:51:51.927267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:51.937581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c13c3-d396-4e1f-a1de-4df74b5e4aed admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:51.993667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:51.994338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:51.994636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:51.994922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:51.995624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:51.996668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:51.996668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:51:51.996668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:51:51.998160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:52.018198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 757/1498] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:51:51 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:51:52.022389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:52.032483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a372a16-e1df-47e2-bd68-4648f495a983 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:52.037033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:52.037688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.037975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.038256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.038971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:52.040022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING py.warnings [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:52.040022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: warnings.warn(msg) May 18 14:51:52.040022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: May 18 14:51:52.040924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:52.054551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 742/1499] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:51:52.059052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:52.069795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988487b9-d025-49aa-b8d8-036c75c5a41a admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:52.074887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f53485-7712-43e5-8404-45626660537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:52.075545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f53485-7712-43e5-8404-45626660537f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.075855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f53485-7712-43e5-8404-45626660537f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.076133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f53485-7712-43e5-8404-45626660537f admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.076895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f53485-7712-43e5-8404-45626660537f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:52.077897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-91f53485-7712-43e5-8404-45626660537f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:52.077897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:51:52.077897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:51:52.078778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f53485-7712-43e5-8404-45626660537f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:52.092783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 758/1500] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:51:52.096864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:52.106823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0235d-0510-46de-b8c1-5b6414b52390 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:52.111437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7027d-6627-4334-bb50-abe0e13a4165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:52.112322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7027d-6627-4334-bb50-abe0e13a4165 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.112643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7027d-6627-4334-bb50-abe0e13a4165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.112929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7027d-6627-4334-bb50-abe0e13a4165 admin admin] PATH_INFO: `/v3/projects/52b5588774fa493bb14848e33abde534/users/27be3231d7e4422ab3a532f2f891655f/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.128031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7027d-6627-4334-bb50-abe0e13a4165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b5588774fa493bb14848e33abde534, user_id=27be3231d7e4422ab3a532f2f891655f, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:52.129109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING py.warnings [None req-efd7027d-6627-4334-bb50-abe0e13a4165 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:52.129109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: warnings.warn(msg) May 18 14:51:52.129109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: May 18 14:51:52.131712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7027d-6627-4334-bb50-abe0e13a4165 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:52.144471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 743/1501] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:51:52 2022] PUT /identity/v3/projects/52b5588774fa493bb14848e33abde534/users/27be3231d7e4422ab3a532f2f891655f/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:51:52.155704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2a1b-2e77-4039-82e9-5965e00ac607 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.156021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2a1b-2e77-4039-82e9-5965e00ac607 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.156327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2a1b-2e77-4039-82e9-5965e00ac607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.183180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-10de2a1b-2e77-4039-82e9-5965e00ac607 None None] MFA Rules not processed for user `27be3231d7e4422ab3a532f2f891655f`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:51:52.184362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-10de2a1b-2e77-4039-82e9-5965e00ac607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:51:52.247148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 759/1502] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:51:52.260629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806117a-85d6-4a7b-a840-46cb3e716f0f None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.260961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806117a-85d6-4a7b-a840-46cb3e716f0f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.261247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806117a-85d6-4a7b-a840-46cb3e716f0f None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.262613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 744/1503] 10.222.0.59 () {54 vars in 963 bytes} [Wed May 18 14:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:51:52.267349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311286b-dcc7-4226-b4ef-40bdf42aeb67 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.267646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311286b-dcc7-4226-b4ef-40bdf42aeb67 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.267938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311286b-dcc7-4226-b4ef-40bdf42aeb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.286138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7311286b-dcc7-4226-b4ef-40bdf42aeb67 None None] MFA Rules not processed for user `6b2524791e2943c2a1eeae24e17c4f34`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:51:52.287291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7311286b-dcc7-4226-b4ef-40bdf42aeb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:51:52.329842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:51:52.339553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 760/1504] 10.222.0.59 () {58 vars in 1060 bytes} [Wed May 18 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:51:52.346968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806117a-85d6-4a7b-a840-46cb3e716f0f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:52.357564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806117a-85d6-4a7b-a840-46cb3e716f0f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:52.361117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:52.361755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.362039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.362319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.370406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:52.371833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:52.380476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 745/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:51:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:51:52.423189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ed6e-0c3b-472e-aeb3-868c2f2d8740 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.423476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ed6e-0c3b-472e-aeb3-868c2f2d8740 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.423753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ed6e-0c3b-472e-aeb3-868c2f2d8740 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.425105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 761/1506] 10.222.0.59 () {52 vars in 829 bytes} [Wed May 18 14:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:51:52.428665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:52.491079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc96a-0f5a-4c51-9cab-06f415b06df4 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:52.495679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:52.496561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.496884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.497167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] PATH_INFO: `/v3/users/27be3231d7e4422ab3a532f2f891655f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.498383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27be3231d7e4422ab3a532f2f891655f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:52.499409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING py.warnings [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:52.499409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: warnings.warn(msg) May 18 14:51:52.499409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: May 18 14:51:52.500691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:52.565877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27be3231d7e4422ab3a532f2f891655f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:52.566425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27be3231d7e4422ab3a532f2f891655f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:52.585203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27be3231d7e4422ab3a532f2f891655f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:52.597178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27be3231d7e4422ab3a532f2f891655f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:52.597979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27be3231d7e4422ab3a532f2f891655f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:52.601922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:51:52.613608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 746/1507] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:51:52 2022] DELETE /identity/v3/users/27be3231d7e4422ab3a532f2f891655f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:51:52.618509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.618800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.619082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.636845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:51:52.638031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:51:52.696267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 762/1508] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:51:52.706439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:52.707830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:51:52.772290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65636505-1e7b-489b-a81c-843f031dca05 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:52.775881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4ffbf-a78d-4f41-9562-2ad4074b3fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:52.776532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ffbf-a78d-4f41-9562-2ad4074b3fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:52.776853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ffbf-a78d-4f41-9562-2ad4074b3fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:52.777137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4ffbf-a78d-4f41-9562-2ad4074b3fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:52.786021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4ffbf-a78d-4f41-9562-2ad4074b3fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:52.787472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4ffbf-a78d-4f41-9562-2ad4074b3fb9 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:52.796804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 747/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:51:53.128433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:51:53.130002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:51:53.142039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706e85f-3f4f-4d34-bd5b-799836a57ac7 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:51:53.146901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:51:53.147822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:51:53.148114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:51:53.148402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] PATH_INFO: `/v3/projects/52b5588774fa493bb14848e33abde534` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:51:53.149708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b5588774fa493bb14848e33abde534)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:51:53.150783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:51:53.150783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:51:53.150783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:51:53.151982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:51:53.213597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b5588774fa493bb14848e33abde534', 'request_id': 'req-9556e577-9d34-409c-ae48-fd5d41a7e8e6'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:53.219596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b5588774fa493bb14848e33abde534', 'request_id': 'req-9556e577-9d34-409c-ae48-fd5d41a7e8e6'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:53.230548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b5588774fa493bb14848e33abde534', 'request_id': 'req-9556e577-9d34-409c-ae48-fd5d41a7e8e6'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:53.249463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] The token cache is being invalidate because project 52b5588774fa493bb14848e33abde534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:51:53.249752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:53.250398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9556e577-9d34-409c-ae48-fd5d41a7e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:51:53.252028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 763/1510] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:51:53 2022] DELETE /identity/v3/projects/52b5588774fa493bb14848e33abde534 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:52:02.792700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:52:03.246499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:53:34.105215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ed9b-fdfe-47d0-b73f-4032185d384e None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:34.105810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ed9b-fdfe-47d0-b73f-4032185d384e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:34.105810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ed9b-fdfe-47d0-b73f-4032185d384e None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:34.107160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:34.112128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83f8c-ca4b-428e-8105-176bbbf56387 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:34.112600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83f8c-ca4b-428e-8105-176bbbf56387 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:34.112729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83f8c-ca4b-428e-8105-176bbbf56387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:34.131327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-78b83f8c-ca4b-428e-8105-176bbbf56387 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:34.132519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-78b83f8c-ca4b-428e-8105-176bbbf56387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:34.190516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:53:34.357536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2ed9b-fdfe-47d0-b73f-4032185d384e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:34.359244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e8d2ed9b-fdfe-47d0-b73f-4032185d384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:34.436196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2ed9b-fdfe-47d0-b73f-4032185d384e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:34.441631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130b28d-077b-4b1f-b434-71bfbab697db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:34.442280 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130b28d-077b-4b1f-b434-71bfbab697db service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:34.442568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130b28d-077b-4b1f-b434-71bfbab697db service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:34.442848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130b28d-077b-4b1f-b434-71bfbab697db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:34.450754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130b28d-077b-4b1f-b434-71bfbab697db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:34.452362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130b28d-077b-4b1f-b434-71bfbab697db service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:34.462063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 749/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:53:35.088214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6cfed-b55d-454b-9194-afe7930caf02 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:35.088508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6cfed-b55d-454b-9194-afe7930caf02 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:35.088827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6cfed-b55d-454b-9194-afe7930caf02 None None] PATH_INFO: `/v3` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:35.090201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 765/1514] 10.222.0.49 () {54 vars in 925 bytes} [Wed May 18 14:53:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:53:35.096415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0702-4ec0-41e3-9e32-04e300010956 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:35.096836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0702-4ec0-41e3-9e32-04e300010956 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:35.097127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0702-4ec0-41e3-9e32-04e300010956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:35.115746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-66de0702-4ec0-41e3-9e32-04e300010956 None None] MFA Rules not processed for user `c316d4242edf4c82afd982127603827c`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:35.117620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-66de0702-4ec0-41e3-9e32-04e300010956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:35.183383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 750/1515] 10.222.0.49 () {58 vars in 1015 bytes} [Wed May 18 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:53:35.361432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ecff8-7361-4026-b92c-8f73209d5af0 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:35.361966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ecff8-7361-4026-b92c-8f73209d5af0 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:35.361966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ecff8-7361-4026-b92c-8f73209d5af0 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:35.363302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 766/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:35.368366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d25c-ca31-4b4e-9c53-6ccb9f67c97f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:35.368696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d25c-ca31-4b4e-9c53-6ccb9f67c97f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:35.368988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d25c-ca31-4b4e-9c53-6ccb9f67c97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:35.386978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c8c7d25c-ca31-4b4e-9c53-6ccb9f67c97f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:35.388180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c8c7d25c-ca31-4b4e-9c53-6ccb9f67c97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:35.396164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 751/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:53:35.544805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ecff8-7361-4026-b92c-8f73209d5af0 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:35.559200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ecff8-7361-4026-b92c-8f73209d5af0 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:35.564558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e3d0-cc6a-4eae-8f51-fc1d9c41ee8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:35.565220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e3d0-cc6a-4eae-8f51-fc1d9c41ee8b service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:35.565508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e3d0-cc6a-4eae-8f51-fc1d9c41ee8b service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:35.565793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e3d0-cc6a-4eae-8f51-fc1d9c41ee8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:35.574321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e3d0-cc6a-4eae-8f51-fc1d9c41ee8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:35.575915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e3d0-cc6a-4eae-8f51-fc1d9c41ee8b service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:35.585188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 767/1518] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:53:43.979757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf909bfe-e284-4be6-b60c-381ab5aec8fa None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:43.980300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf909bfe-e284-4be6-b60c-381ab5aec8fa None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:43.980300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf909bfe-e284-4be6-b60c-381ab5aec8fa None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:43.981734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 752/1519] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 18 14:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:43.986748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17645bb5-b19c-4408-81d3-ddb0a747a939 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:43.987138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17645bb5-b19c-4408-81d3-ddb0a747a939 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:43.987304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17645bb5-b19c-4408-81d3-ddb0a747a939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:44.007808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-17645bb5-b19c-4408-81d3-ddb0a747a939 None None] MFA Rules not processed for user `c316d4242edf4c82afd982127603827c`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:44.009344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-17645bb5-b19c-4408-81d3-ddb0a747a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:44.018066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 768/1520] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 18 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:53:44.025653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf909bfe-e284-4be6-b60c-381ab5aec8fa None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:44.038862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf909bfe-e284-4be6-b60c-381ab5aec8fa None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:44.044350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dfe3a-5ced-4ba7-bd45-05fa64a86f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:44.045015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dfe3a-5ced-4ba7-bd45-05fa64a86f24 service placement] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:44.045307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dfe3a-5ced-4ba7-bd45-05fa64a86f24 service placement] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:44.045588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dfe3a-5ced-4ba7-bd45-05fa64a86f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:44.054046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dfe3a-5ced-4ba7-bd45-05fa64a86f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:44.055657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dfe3a-5ced-4ba7-bd45-05fa64a86f24 service placement] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:44.065772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 753/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:53:46.862915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c07ca-e2cf-4597-8643-57018e6094f3 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:46.863507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c07ca-e2cf-4597-8643-57018e6094f3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:46.863507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c07ca-e2cf-4597-8643-57018e6094f3 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:46.865076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:46.870418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474bb66-5b9b-40ff-ada4-498002399901 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:46.870818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474bb66-5b9b-40ff-ada4-498002399901 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:46.870983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474bb66-5b9b-40ff-ada4-498002399901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:46.888825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c474bb66-5b9b-40ff-ada4-498002399901 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:46.890034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c474bb66-5b9b-40ff-ada4-498002399901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:46.898099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:53:47.051068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c07ca-e2cf-4597-8643-57018e6094f3 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:47.066969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c07ca-e2cf-4597-8643-57018e6094f3 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:47.072330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4bda-f7d5-4678-bfbd-d4eab31557a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:47.073000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4bda-f7d5-4678-bfbd-d4eab31557a1 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:47.073288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4bda-f7d5-4678-bfbd-d4eab31557a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:47.073568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4bda-f7d5-4678-bfbd-d4eab31557a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:47.081601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4bda-f7d5-4678-bfbd-d4eab31557a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:47.083194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4bda-f7d5-4678-bfbd-d4eab31557a1 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:47.092990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 770/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:53:47.986830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cb3aa-a5be-412c-8f0e-556a48b5ca0c None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:47.987369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cb3aa-a5be-412c-8f0e-556a48b5ca0c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:47.987369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cb3aa-a5be-412c-8f0e-556a48b5ca0c None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:47.988787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:47.994285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d789c2-93a1-448b-8836-498a44fa038e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:47.994686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d789c2-93a1-448b-8836-498a44fa038e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:47.994833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d789c2-93a1-448b-8836-498a44fa038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:48.012892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-34d789c2-93a1-448b-8836-498a44fa038e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:48.014066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-34d789c2-93a1-448b-8836-498a44fa038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:48.021565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:53:48.171439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cb3aa-a5be-412c-8f0e-556a48b5ca0c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:48.186709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cb3aa-a5be-412c-8f0e-556a48b5ca0c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:48.192549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c624-ee1b-4051-993d-dea7fd954c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:48.193236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c624-ee1b-4051-993d-dea7fd954c8b service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:48.193518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c624-ee1b-4051-993d-dea7fd954c8b service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:48.193796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c624-ee1b-4051-993d-dea7fd954c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:48.203051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779c624-ee1b-4051-993d-dea7fd954c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:48.204667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779c624-ee1b-4051-993d-dea7fd954c8b service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:48.213899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 756/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:53:52.494990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c10c2-3bab-42f4-969c-4dc39724629c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:52.495514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c10c2-3bab-42f4-969c-4dc39724629c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:52.495514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c10c2-3bab-42f4-969c-4dc39724629c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:52.496919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:52.502354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534e8f2-e060-4145-9e33-848bd7db02c7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:52.502791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534e8f2-e060-4145-9e33-848bd7db02c7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:52.502908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534e8f2-e060-4145-9e33-848bd7db02c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:52.520738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5534e8f2-e060-4145-9e33-848bd7db02c7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:52.521937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5534e8f2-e060-4145-9e33-848bd7db02c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:52.530284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:53:52.574255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c10c2-3bab-42f4-969c-4dc39724629c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:52.576002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-950c10c2-3bab-42f4-969c-4dc39724629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:52.633016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c10c2-3bab-42f4-969c-4dc39724629c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:52.636597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb6e73-ae23-4e4f-a5df-456f4b8a4a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:52.637242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb6e73-ae23-4e4f-a5df-456f4b8a4a71 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:52.637528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb6e73-ae23-4e4f-a5df-456f4b8a4a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:52.637807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb6e73-ae23-4e4f-a5df-456f4b8a4a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:52.646508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb6e73-ae23-4e4f-a5df-456f4b8a4a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:52.647927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb6e73-ae23-4e4f-a5df-456f4b8a4a71 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:52.657839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 773/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:53:54.843531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85cf8-a265-42ca-b74a-016046e96db1 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:54.844054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85cf8-a265-42ca-b74a-016046e96db1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:54.844183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85cf8-a265-42ca-b74a-016046e96db1 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:54.845533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:54.851271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fde87-d0a9-4fe9-a37a-f2e45339578d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:54.851721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fde87-d0a9-4fe9-a37a-f2e45339578d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:54.852321 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fde87-d0a9-4fe9-a37a-f2e45339578d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:54.871716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d79fde87-d0a9-4fe9-a37a-f2e45339578d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:54.872956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d79fde87-d0a9-4fe9-a37a-f2e45339578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:54.880793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:53:54.916693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f85cf8-a265-42ca-b74a-016046e96db1 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:54.918358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-72f85cf8-a265-42ca-b74a-016046e96db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:54.932076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f85cf8-a265-42ca-b74a-016046e96db1 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:54.935768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129d108-bdbe-47ef-b713-5977c63e7e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:54.936408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129d108-bdbe-47ef-b713-5977c63e7e3b service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:54.936731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129d108-bdbe-47ef-b713-5977c63e7e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:54.937020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129d108-bdbe-47ef-b713-5977c63e7e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:54.946024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129d108-bdbe-47ef-b713-5977c63e7e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:54.948087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129d108-bdbe-47ef-b713-5977c63e7e3b service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:54.957400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 759/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:53:58.682405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2ac41-4b57-4edb-b71b-f31a2ff40bea None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:58.682955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2ac41-4b57-4edb-b71b-f31a2ff40bea None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:58.682955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2ac41-4b57-4edb-b71b-f31a2ff40bea None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:58.684262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:53:58.689526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0f43f-8fd4-4154-b84c-f334374d96ec None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:58.689944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0f43f-8fd4-4154-b84c-f334374d96ec None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:58.690092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0f43f-8fd4-4154-b84c-f334374d96ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:58.710131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2af0f43f-8fd4-4154-b84c-f334374d96ec None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:53:58.711344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2af0f43f-8fd4-4154-b84c-f334374d96ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:58.719811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:53:58.994791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2ac41-4b57-4edb-b71b-f31a2ff40bea None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:53:58.996491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8fd2ac41-4b57-4edb-b71b-f31a2ff40bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:53:59.067620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2ac41-4b57-4edb-b71b-f31a2ff40bea None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:53:59.071248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc989a-7098-48fd-b710-92218c586c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:53:59.071920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc989a-7098-48fd-b710-92218c586c35 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:53:59.072224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc989a-7098-48fd-b710-92218c586c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:53:59.072481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc989a-7098-48fd-b710-92218c586c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:53:59.081367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc989a-7098-48fd-b710-92218c586c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:53:59.082813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc989a-7098-48fd-b710-92218c586c35 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:53:59.088066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:53:59.093236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 776/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:54:01.363719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7878d-889d-4786-8459-ba7d86bdd3dd None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:54:01.364228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7878d-889d-4786-8459-ba7d86bdd3dd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:54:01.364228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7878d-889d-4786-8459-ba7d86bdd3dd None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:54:01.365629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:54:01.370739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d1164-1b43-444d-822c-dfd9d46f620d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:54:01.371175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d1164-1b43-444d-822c-dfd9d46f620d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:54:01.371327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d1164-1b43-444d-822c-dfd9d46f620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:54:01.389203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c50d1164-1b43-444d-822c-dfd9d46f620d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:54:01.390399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c50d1164-1b43-444d-822c-dfd9d46f620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:54:01.398158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:54:01.663983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7878d-889d-4786-8459-ba7d86bdd3dd None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:54:01.666290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e6f7878d-889d-4786-8459-ba7d86bdd3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:54:01.679455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7878d-889d-4786-8459-ba7d86bdd3dd None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:54:01.683103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3484c6-a08e-486c-8b69-f8405e957ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:54:01.683738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3484c6-a08e-486c-8b69-f8405e957ace service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:54:01.684024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3484c6-a08e-486c-8b69-f8405e957ace service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:54:01.684307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3484c6-a08e-486c-8b69-f8405e957ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:54:01.693129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3484c6-a08e-486c-8b69-f8405e957ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:54:01.694551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3484c6-a08e-486c-8b69-f8405e957ace service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:54:01.704189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 762/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:54:11.383949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:54:11.700135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:33.555183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ab76c-3d60-4f04-925b-8bc114356aed None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:33.555770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ab76c-3d60-4f04-925b-8bc114356aed None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:33.555953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ab76c-3d60-4f04-925b-8bc114356aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:33.587205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c54ab76c-3d60-4f04-925b-8bc114356aed None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:33.588438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c54ab76c-3d60-4f04-925b-8bc114356aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:33.603208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 778/1540] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:33.615067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ac9ab-2c8b-46f6-8489-878f90de9118 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:33.616277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ac9ab-2c8b-46f6-8489-878f90de9118 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:33.617351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ac9ab-2c8b-46f6-8489-878f90de9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:33.645883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-075ac9ab-2c8b-46f6-8489-878f90de9118 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:33.647535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-075ac9ab-2c8b-46f6-8489-878f90de9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:33.658130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 763/1541] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:33.664556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ab76c-3d60-4f04-925b-8bc114356aed None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:33.680053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ab76c-3d60-4f04-925b-8bc114356aed None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:33.686740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:33.687438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:33.687723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:33.688157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:33.688957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:33.689279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:33.690943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:33.716861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 779/1542] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:33.725492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ac9ab-2c8b-46f6-8489-878f90de9118 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:33.740606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ac9ab-2c8b-46f6-8489-878f90de9118 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:33.752257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b3787-791c-46df-ab67-8c46e19b1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:33.753569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b3787-791c-46df-ab67-8c46e19b1d1f admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:33.754100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b3787-791c-46df-ab67-8c46e19b1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:33.754602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b3787-791c-46df-ab67-8c46e19b1d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:33.755536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b3787-791c-46df-ab67-8c46e19b1d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:33.757962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b3787-791c-46df-ab67-8c46e19b1d1f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:33.822644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 764/1543] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:33 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:33.827625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:33.839514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac228b38-e548-4827-bc5e-52e05d4cfdf5 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:33.841114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653b452-e617-4252-bc3f-d13103b09729 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:33.841650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653b452-e617-4252-bc3f-d13103b09729 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:33.842275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653b452-e617-4252-bc3f-d13103b09729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:33.882815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a653b452-e617-4252-bc3f-d13103b09729 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:33.884618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a653b452-e617-4252-bc3f-d13103b09729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:33.966358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5411a3-6d8e-4430-8c01-278928502a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:33.967524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5411a3-6d8e-4430-8c01-278928502a7e admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:33.968124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5411a3-6d8e-4430-8c01-278928502a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:33.970103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5411a3-6d8e-4430-8c01-278928502a7e admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:33.972762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5411a3-6d8e-4430-8c01-278928502a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:33.981009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5411a3-6d8e-4430-8c01-278928502a7e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.026393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 780/1544] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:33 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.028152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c2724-5e1e-48f0-b142-9ed7a9cd2052 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.032118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 765/1545] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.032118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333e3f-6fe1-4e1a-a016-f562412f4beb None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.032118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333e3f-6fe1-4e1a-a016-f562412f4beb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.032118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333e3f-6fe1-4e1a-a016-f562412f4beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.033169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c2724-5e1e-48f0-b142-9ed7a9cd2052 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.033676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c2724-5e1e-48f0-b142-9ed7a9cd2052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.057397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c9333e3f-6fe1-4e1a-a016-f562412f4beb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.060451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c9333e3f-6fe1-4e1a-a016-f562412f4beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.068468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e08c2724-5e1e-48f0-b142-9ed7a9cd2052 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.068468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e08c2724-5e1e-48f0-b142-9ed7a9cd2052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.077196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 766/1546] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.077673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 781/1547] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.078841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed8ff2-1664-4d9e-80e8-d71c6e2ab71b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.079133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed8ff2-1664-4d9e-80e8-d71c6e2ab71b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.079258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512929-ed64-441e-8067-70abd7a56b1c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.079462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed8ff2-1664-4d9e-80e8-d71c6e2ab71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.079595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512929-ed64-441e-8067-70abd7a56b1c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.079882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512929-ed64-441e-8067-70abd7a56b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.100614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-91512929-ed64-441e-8067-70abd7a56b1c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.101370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-caed8ff2-1664-4d9e-80e8-d71c6e2ab71b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.102467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-91512929-ed64-441e-8067-70abd7a56b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.102606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-caed8ff2-1664-4d9e-80e8-d71c6e2ab71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.110454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 782/1548] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.110595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 767/1549] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.111047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91512929-ed64-441e-8067-70abd7a56b1c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.118092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372a7a-ef97-4fa1-b372-8ef021211f09 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.118474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372a7a-ef97-4fa1-b372-8ef021211f09 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.118740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372a7a-ef97-4fa1-b372-8ef021211f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.121087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91512929-ed64-441e-8067-70abd7a56b1c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.125770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67631f8a-a855-4f4d-8033-4074a1ae88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.126471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631f8a-a855-4f4d-8033-4074a1ae88d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.126760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631f8a-a855-4f4d-8033-4074a1ae88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.127043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631f8a-a855-4f4d-8033-4074a1ae88d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.127771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631f8a-a855-4f4d-8033-4074a1ae88d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.129403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631f8a-a855-4f4d-8033-4074a1ae88d0 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.138789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f2372a7a-ef97-4fa1-b372-8ef021211f09 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.139401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 783/1550] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:34.139976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f2372a7a-ef97-4fa1-b372-8ef021211f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.140623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b006f1-edc1-4801-a493-1a0c2748c94c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.140922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b006f1-edc1-4801-a493-1a0c2748c94c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.141207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b006f1-edc1-4801-a493-1a0c2748c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.149862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 768/1551] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.151130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17bfbe-a3a1-4be0-a50b-35f6953c24f7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.151608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17bfbe-a3a1-4be0-a50b-35f6953c24f7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.151953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17bfbe-a3a1-4be0-a50b-35f6953c24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.159053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-96b006f1-edc1-4801-a493-1a0c2748c94c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.160235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-96b006f1-edc1-4801-a493-1a0c2748c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.168666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 784/1552] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.169835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-7b17bfbe-a3a1-4be0-a50b-35f6953c24f7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.169981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c832c7-3706-440f-8d47-d3487e3e5577 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.170156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c832c7-3706-440f-8d47-d3487e3e5577 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.170437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c832c7-3706-440f-8d47-d3487e3e5577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.170987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7b17bfbe-a3a1-4be0-a50b-35f6953c24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.178935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 769/1553] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.180164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f008b-c3d6-4630-a921-1f27422f4e68 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.180451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f008b-c3d6-4630-a921-1f27422f4e68 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.180759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f008b-c3d6-4630-a921-1f27422f4e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.188879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c8c832c7-3706-440f-8d47-d3487e3e5577 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.190065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c8c832c7-3706-440f-8d47-d3487e3e5577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.197938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 785/1554] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.199177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787525-8cfc-456d-b5bb-415970cc40a8 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.199464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787525-8cfc-456d-b5bb-415970cc40a8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.199743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787525-8cfc-456d-b5bb-415970cc40a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.205196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-de0f008b-c3d6-4630-a921-1f27422f4e68 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.206571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-de0f008b-c3d6-4630-a921-1f27422f4e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.216282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 770/1555] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.217653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7071800-4794-414e-b41d-0731382fe55b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.217949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7071800-4794-414e-b41d-0731382fe55b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.218232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7071800-4794-414e-b41d-0731382fe55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.220314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-28787525-8cfc-456d-b5bb-415970cc40a8 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.221551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-28787525-8cfc-456d-b5bb-415970cc40a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.231592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 786/1556] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.232757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787525-8cfc-456d-b5bb-415970cc40a8 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.236516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c7071800-4794-414e-b41d-0731382fe55b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.237722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c7071800-4794-414e-b41d-0731382fe55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.242263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787525-8cfc-456d-b5bb-415970cc40a8 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.245505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 771/1557] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.246366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7071800-4794-414e-b41d-0731382fe55b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.249629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971e1eb-e3c3-4ef4-9d35-d7a1faf5b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.250292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e1eb-e3c3-4ef4-9d35-d7a1faf5b772 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.250579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e1eb-e3c3-4ef4-9d35-d7a1faf5b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.251056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e1eb-e3c3-4ef4-9d35-d7a1faf5b772 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.251791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971e1eb-e3c3-4ef4-9d35-d7a1faf5b772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.253954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971e1eb-e3c3-4ef4-9d35-d7a1faf5b772 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.255672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7071800-4794-414e-b41d-0731382fe55b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.260303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.260978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.261264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.261540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.262256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:34.262566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.263584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING py.warnings [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:55:34.263584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: warnings.warn(msg) May 18 14:55:34.263584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: May 18 14:55:34.264039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 787/1558] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:34.264476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c11bd-9079-43ac-8fa0-09192eaa5e42 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.265267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9f1bb-42bc-4f30-accf-c2acf789d9c9 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.265561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9f1bb-42bc-4f30-accf-c2acf789d9c9 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.265845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9f1bb-42bc-4f30-accf-c2acf789d9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.278577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 772/1559] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:34.279727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5da65-90d8-4294-9f73-e12e5551ed15 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.280135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5da65-90d8-4294-9f73-e12e5551ed15 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.280302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5da65-90d8-4294-9f73-e12e5551ed15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.284134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-47c9f1bb-42bc-4f30-accf-c2acf789d9c9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.285616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-47c9f1bb-42bc-4f30-accf-c2acf789d9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.294394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 788/1560] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.295244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9f1bb-42bc-4f30-accf-c2acf789d9c9 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.298702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-56a5da65-90d8-4294-9f73-e12e5551ed15 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.300562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-56a5da65-90d8-4294-9f73-e12e5551ed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.304797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9f1bb-42bc-4f30-accf-c2acf789d9c9 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.308632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 773/1561] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.309459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.310107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.310394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.310676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.311401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:34.311713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.312822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5da65-90d8-4294-9f73-e12e5551ed15 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.313446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.322149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5da65-90d8-4294-9f73-e12e5551ed15 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.332053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 789/1562] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:34.332053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.332316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.332316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.332316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.332316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.332672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:34.332672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.334035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.336077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7bd80-87d5-4df3-8234-0f22c099412b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.340605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.341247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.341536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.341818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.342529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:34.342840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.344392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.346150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 774/1563] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:34.346938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.358395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6c47-44d4-48b9-a8bb-68f571a44737 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.358562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 790/1564] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:34.359485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.363461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.364679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.365189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.365690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.366412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:34.366721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.368346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.369121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f925b-036a-4296-b95e-15060ecda4e4 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.373683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.374622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.374915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.375202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] PATH_INFO: `/v3/projects/8861f7058f96459fa715dddf23cc3908/users/4e4769e15ff54700be019d0b0dee5f64/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.380471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 775/1565] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:34.381275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.390729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685013f-38ef-4b12-8111-1e22df0c32f6 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.394538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8861f7058f96459fa715dddf23cc3908, user_id=4e4769e15ff54700be019d0b0dee5f64, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.395410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.395612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:55:34.395612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:55:34.395612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:55:34.396056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.396346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.396661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.397349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.398063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.399807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.412605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 791/1566] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:34 2022] PUT /identity/v3/projects/8861f7058f96459fa715dddf23cc3908/users/4e4769e15ff54700be019d0b0dee5f64/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:34.417641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.427730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 776/1567] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.428325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.440301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:34.459528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:34.486866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344210a-8be5-48ef-9b84-69fd0130c6f3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.496162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c09aa3-b526-41de-a41c-ab7db4aa4971 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.500935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.501638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.501926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.502211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.503315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:34.503315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.504954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.517021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 777/1568] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:34.517679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.527790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b7cec-c165-4013-a84e-72c723e983aa admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.532408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.533083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.533369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.533653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.534331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.536225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.546741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.547417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.547704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.548011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.548862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:34.549153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.551006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.563166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 792/1569] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:34.564070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 778/1570] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.564070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.568153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.579571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d11825-f6f8-45d2-9c4b-0d28a200c467 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.629360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06a75-fce5-40ca-8057-7202654fd51d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.634496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.635166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.635328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0489-9796-4a3a-878b-5e3e0395ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.635454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.635712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.635981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0489-9796-4a3a-878b-5e3e0395ac5b admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.636266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0489-9796-4a3a-878b-5e3e0395ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.636398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.636544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0489-9796-4a3a-878b-5e3e0395ac5b admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.637256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae0489-9796-4a3a-878b-5e3e0395ac5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.638263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-44ae0489-9796-4a3a-878b-5e3e0395ac5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:55:34.638263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:55:34.638263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:55:34.638539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.639463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae0489-9796-4a3a-878b-5e3e0395ac5b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.664535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 779/1571] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.668184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 793/1572] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.668319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.668433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20aaa-a3ba-4978-9ebf-35fdc096786b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.668433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20aaa-a3ba-4978-9ebf-35fdc096786b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.668433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20aaa-a3ba-4978-9ebf-35fdc096786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.683600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c6f20aaa-a3ba-4978-9ebf-35fdc096786b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:34.684828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c6f20aaa-a3ba-4978-9ebf-35fdc096786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:34.724290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:34.730437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622be4a-8f78-4d88-bb52-b466d4d3e582 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.743789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 794/1573] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:34.747113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f20aaa-a3ba-4978-9ebf-35fdc096786b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.753565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f20aaa-a3ba-4978-9ebf-35fdc096786b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.758630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.759383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.759522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:34.759636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.759816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.760568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.762665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.784085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 795/1574] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.784085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.794370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53820-e2c7-4354-982a-679ffd82bd54 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.796023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.796730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.797025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.797306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.797997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.798951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.799835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.800122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.800230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.800401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.801156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.803046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.829556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 780/1575] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.829556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.829872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 796/1576] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.832821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.890573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14f56c-9ca7-4056-bf86-d48e0b2108f8 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.894454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a884f-d5fc-4046-aa76-197543929fc6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.895096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.895767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.896051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.896327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.897040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.898097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING py.warnings [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:55:34.898097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: warnings.warn(msg) May 18 14:55:34.898097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: May 18 14:55:34.899148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.899296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.899805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.900100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.900381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.901099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.903012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.919720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 781/1577] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.920677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.931395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc3151-f60e-4a9c-af33-4a13a0bff84e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:34.933949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 797/1578] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.934844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:34.938933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:34.939597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:34.939887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:34.940179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:34.940877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:34.942842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:34.964363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 782/1579] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/users => generated 278 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:34.965197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.002096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a2000-3fcf-4723-8d10-4336e80f3293 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.006830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.008063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.008353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.008666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.009367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.011317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.021451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983318-12f3-4680-b5de-f0f11430fa62 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.032034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 798/1580] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:34 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:35.032727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.042330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85f93-a27f-4ef5-bd1e-615178e5f9c6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.046997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.047640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.047928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.048206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.048976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.050813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.062858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 799/1581] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.063797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.064453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:35.074270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f06e14-c483-40ac-815a-d0a08b81e191 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.077261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.077930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.078219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.078501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.078977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.079648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.079934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.080212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.080931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.082831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.087962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.089466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.090349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:35.099972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 783/1582] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:35.100914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.103453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 800/1583] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:35 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:35.104398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.110369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a32be-7eba-4d1a-abb2-ce25e3896bcb service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.115870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.117129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.117265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe3eb-77dd-464b-9e72-6a330f7fd4e0 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.117664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.118071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.118868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.121347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.122401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.123087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.123396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.123682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.124530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.126092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.140343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 801/1584] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.140343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.147887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 784/1585] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:35 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:35.147887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.153776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934553e-d57a-4ea8-90d3-58c9edd40294 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.159189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.159965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b251f-88de-4fb7-9c01-8b688b42e531 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.160078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.160259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.160542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.161337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.163355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.166972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.167681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.168366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.168930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.170092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.172880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.185947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 802/1586] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:35 2022] POST /identity/v3/users => generated 296 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:35.193449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 785/1587] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.193648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.193754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.202327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6458509-5bb3-45d9-abde-a19677c97e5b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.207129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.207798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.208089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.208369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.208853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215a73-dd6e-4412-a07a-db2705e7a7b1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.209140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.210956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.216286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.217013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.217319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.217615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.218379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.219987 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.223150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 786/1588] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.223812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.239057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 803/1589] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.239283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c1bb-a013-4a1a-99ba-395437e42a7b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.240325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.250471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.251169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.259618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.260196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.260346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d93d2-7ea8-4ae8-b912-beeb2f0ee8b8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.262595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.264945 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.270935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.271910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.272198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.272482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.273283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.275132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.285392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 787/1590] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.286798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.292485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 804/1591] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.292485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.299723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffbb65-5f22-4988-938d-f75b07dab9c0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.304945 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.305639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.305931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.306194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ee96d-3bb7-4bd4-a9ad-6a19206d3ca9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.306325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.307537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.308546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.314724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.315550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.316928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.317343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.318208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.320401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.325810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 788/1592] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.325810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.332380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 805/1593] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.336875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.339612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfff1e-6834-459e-b172-b21bd4d6b86e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.346024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.346700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.346989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.347252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20384c37-5abf-4da1-9dbf-58ab8ea44283 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.347356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.348227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.350091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.353621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.354606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.354964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.355318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] PATH_INFO: `/v3/projects/b4890d7d8a4c4f129840f48d5fb6b405/users/476a193861874fcbb7bff6038bb02ee4/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.364671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 789/1594] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.364671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.375620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3cfc7-7506-4c4d-9028-602217f9e948 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.376762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4890d7d8a4c4f129840f48d5fb6b405, user_id=476a193861874fcbb7bff6038bb02ee4, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.380119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.380766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.381507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.381872 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.382270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.383077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.385107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.396072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 790/1595] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.400768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.400916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 806/1596] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:35 2022] PUT /identity/v3/projects/b4890d7d8a4c4f129840f48d5fb6b405/users/476a193861874fcbb7bff6038bb02ee4/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:35.400916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.414128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88003d03-2126-4870-8501-2ca1e56a0dfd admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.483536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c3adf-17c9-475c-a2f2-faa2ec48f4ec admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.483908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.484683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.484976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.485635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.486563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.488440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.492303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.493380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.493910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.494339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] PATH_INFO: `/v3/projects/baa191cea5ac42908b39dc6b84748148/users/b21d00320f764fd98e4c22c46b4808f2/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.503656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 791/1597] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.504525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.515129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e67c9-a123-4430-85c0-91d3828f014d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.520268 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.521106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.521402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.521684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.522427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.523661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa191cea5ac42908b39dc6b84748148, user_id=b21d00320f764fd98e4c22c46b4808f2, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.524091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.527932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.540422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 792/1598] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.540422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.550656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f4fb-acd0-45f7-a0aa-a5c324596a77 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.554929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 807/1599] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:35 2022] PUT /identity/v3/projects/baa191cea5ac42908b39dc6b84748148/users/b21d00320f764fd98e4c22c46b4808f2/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:35.558016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.605637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:35.628019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.628744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.629033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.629316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.630053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.631679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.638402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:35.642845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 793/1600] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:35.643752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.654433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516624c-c30c-4353-bc4b-4981b2297ca4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.658313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f276de-1e9a-4393-aff3-c64f3165723e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.661924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45539ca-9491-4a5b-81f6-5de676705dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.662820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45539ca-9491-4a5b-81f6-5de676705dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.663108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45539ca-9491-4a5b-81f6-5de676705dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.663956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45539ca-9491-4a5b-81f6-5de676705dd4 admin admin] PATH_INFO: `/v3/projects/9c46dc2b21d34158bf2a7eb0e39c06a3/users/25784e3193b047ecaa6788bd79611f3f/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.664616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.665587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.665880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.666318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] PATH_INFO: `/v3/projects/676e0b467ffe492a9388b31c5ce70da0/users/c7b2a2a1215841f597c4d0defbb65f4d/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.681760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45539ca-9491-4a5b-81f6-5de676705dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c46dc2b21d34158bf2a7eb0e39c06a3, user_id=25784e3193b047ecaa6788bd79611f3f, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.683370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=676e0b467ffe492a9388b31c5ce70da0, user_id=c7b2a2a1215841f597c4d0defbb65f4d, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.684444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45539ca-9491-4a5b-81f6-5de676705dd4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.686309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.699411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 794/1601] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:35 2022] PUT /identity/v3/projects/9c46dc2b21d34158bf2a7eb0e39c06a3/users/25784e3193b047ecaa6788bd79611f3f/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:35.702149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db15d2-e2da-4caf-8867-d1724a66da62 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.702699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db15d2-e2da-4caf-8867-d1724a66da62 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.703213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db15d2-e2da-4caf-8867-d1724a66da62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.708696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 808/1602] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:35 2022] PUT /identity/v3/projects/676e0b467ffe492a9388b31c5ce70da0/users/c7b2a2a1215841f597c4d0defbb65f4d/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:35.709853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.736169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-14db15d2-e2da-4caf-8867-d1724a66da62 None None] MFA Rules not processed for user `476a193861874fcbb7bff6038bb02ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:35.739021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-14db15d2-e2da-4caf-8867-d1724a66da62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:35.781524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d337-413d-4a1c-aa83-ce1e24a54acb admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.786342 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.787231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.787521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.787802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] PATH_INFO: `/v3/projects/caa15bf50ba64a59b14643c504d61fb1/users/25967732542c4a28a38b1b8a121037f1/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.806212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa15bf50ba64a59b14643c504d61fb1, user_id=25967732542c4a28a38b1b8a121037f1, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.809292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.832496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 809/1603] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:35 2022] PUT /identity/v3/projects/caa15bf50ba64a59b14643c504d61fb1/users/25967732542c4a28a38b1b8a121037f1/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:35.832943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 795/1604] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:35.834649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881162-73ea-4935-a8e9-195b01455b2f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.835744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881162-73ea-4935-a8e9-195b01455b2f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.836104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881162-73ea-4935-a8e9-195b01455b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.838524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.880381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-42881162-73ea-4935-a8e9-195b01455b2f None None] MFA Rules not processed for user `b21d00320f764fd98e4c22c46b4808f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:35.882144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-42881162-73ea-4935-a8e9-195b01455b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:35.937682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f441d7-fcdd-4b82-9ee4-5200e3f3b33e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.943594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e8e46-4634-4fd6-8b2c-f35efe307c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:35.944803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e8e46-4634-4fd6-8b2c-f35efe307c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.945300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e8e46-4634-4fd6-8b2c-f35efe307c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.945799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e8e46-4634-4fd6-8b2c-f35efe307c9f admin admin] PATH_INFO: `/v3/projects/40e4e55c987d45fcb8a292f34b2f6ac3/users/23055a6dbcae4f7ca7a3db94d82a10eb/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:35.961747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e8e46-4634-4fd6-8b2c-f35efe307c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e4e55c987d45fcb8a292f34b2f6ac3, user_id=23055a6dbcae4f7ca7a3db94d82a10eb, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:35.967156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 796/1605] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:35.967348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e8e46-4634-4fd6-8b2c-f35efe307c9f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:35.967464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881162-73ea-4935-a8e9-195b01455b2f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:35.979721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881162-73ea-4935-a8e9-195b01455b2f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:35.982325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 810/1606] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:35 2022] PUT /identity/v3/projects/40e4e55c987d45fcb8a292f34b2f6ac3/users/23055a6dbcae4f7ca7a3db94d82a10eb/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:35.983768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f679e7-1777-4519-a1ed-770433fe1ddc None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:35.984084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f679e7-1777-4519-a1ed-770433fe1ddc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:35.984353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f679e7-1777-4519-a1ed-770433fe1ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.002714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-30f679e7-1777-4519-a1ed-770433fe1ddc None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.003938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-30f679e7-1777-4519-a1ed-770433fe1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.019888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.049008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21705a0d-034e-4f33-ae7b-80e81f028529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.050179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21705a0d-034e-4f33-ae7b-80e81f028529 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.050468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21705a0d-034e-4f33-ae7b-80e81f028529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.050752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21705a0d-034e-4f33-ae7b-80e81f028529 admin admin] PATH_INFO: `/v3/projects/84835592358a4e188df86896d6015647/users/2aa34e012c824754833a12ac66413aaf/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.051468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.066228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21705a0d-034e-4f33-ae7b-80e81f028529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84835592358a4e188df86896d6015647, user_id=2aa34e012c824754833a12ac66413aaf, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.068999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21705a0d-034e-4f33-ae7b-80e81f028529 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.081760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 811/1607] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.083190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486e59-0c57-456e-898c-95576c8f7d6d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.083485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486e59-0c57-456e-898c-95576c8f7d6d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.083771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486e59-0c57-456e-898c-95576c8f7d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.092181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 797/1608] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:35 2022] PUT /identity/v3/projects/84835592358a4e188df86896d6015647/users/2aa34e012c824754833a12ac66413aaf/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:36.092181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0cc04-edd2-4f21-bf10-0112be915665 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.092181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0cc04-edd2-4f21-bf10-0112be915665 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.092181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0cc04-edd2-4f21-bf10-0112be915665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.114972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f8486e59-0c57-456e-898c-95576c8f7d6d None None] MFA Rules not processed for user `c7b2a2a1215841f597c4d0defbb65f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.116482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f8486e59-0c57-456e-898c-95576c8f7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.117943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e7a0cc04-edd2-4f21-bf10-0112be915665 None None] MFA Rules not processed for user `4e4769e15ff54700be019d0b0dee5f64`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.119115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e7a0cc04-edd2-4f21-bf10-0112be915665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.182882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 812/1609] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.184177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 798/1610] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.184753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e73758-88c9-46b3-b320-cb51d5bd5d61 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.185340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e73758-88c9-46b3-b320-cb51d5bd5d61 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.185464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8045-d9a3-4ab7-9bc0-45477c11f65f None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.185669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8045-d9a3-4ab7-9bc0-45477c11f65f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.185953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8045-d9a3-4ab7-9bc0-45477c11f65f None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.186374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e73758-88c9-46b3-b320-cb51d5bd5d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.187485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 799/1611] 10.222.0.59 () {54 vars in 961 bytes} [Wed May 18 14:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:36.188190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8045-d9a3-4ab7-9bc0-45477c11f65f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.221530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b8e73758-88c9-46b3-b320-cb51d5bd5d61 None None] MFA Rules not processed for user `25967732542c4a28a38b1b8a121037f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.222741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b8e73758-88c9-46b3-b320-cb51d5bd5d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.255720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8045-d9a3-4ab7-9bc0-45477c11f65f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.260933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0340d-d4df-4f3a-b6d9-0a3a9eeb938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.261602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0340d-d4df-4f3a-b6d9-0a3a9eeb938d admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.261890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0340d-d4df-4f3a-b6d9-0a3a9eeb938d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.262173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0340d-d4df-4f3a-b6d9-0a3a9eeb938d admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.262867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0340d-d4df-4f3a-b6d9-0a3a9eeb938d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.264914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0340d-d4df-4f3a-b6d9-0a3a9eeb938d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.291425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 813/1612] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.292903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6ef55-4332-4ac2-9122-8215442d02e1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.293199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6ef55-4332-4ac2-9122-8215442d02e1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.293480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6ef55-4332-4ac2-9122-8215442d02e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.296758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 800/1613] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:36.296758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3ab3-da38-4493-9d92-ea21c9468847 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.296758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3ab3-da38-4493-9d92-ea21c9468847 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.296758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3ab3-da38-4493-9d92-ea21c9468847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.314539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b83b3ab3-da38-4493-9d92-ea21c9468847 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.315828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b83b3ab3-da38-4493-9d92-ea21c9468847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.333314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-faf6ef55-4332-4ac2-9122-8215442d02e1 None None] MFA Rules not processed for user `23055a6dbcae4f7ca7a3db94d82a10eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.334507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-faf6ef55-4332-4ac2-9122-8215442d02e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.350125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.383800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.388097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 801/1614] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.389073 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3ab3-da38-4493-9d92-ea21c9468847 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.409269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 814/1615] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.410232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6ef55-4332-4ac2-9122-8215442d02e1 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.421830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6ef55-4332-4ac2-9122-8215442d02e1 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.427952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781a61-1dae-4022-b434-35ffb84c46ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.428696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781a61-1dae-4022-b434-35ffb84c46ad admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.429523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781a61-1dae-4022-b434-35ffb84c46ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.429798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781a61-1dae-4022-b434-35ffb84c46ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.430509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73781a61-1dae-4022-b434-35ffb84c46ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.432484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73781a61-1dae-4022-b434-35ffb84c46ad admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.460230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3ab3-da38-4493-9d92-ea21c9468847 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.463587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 815/1616] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:36.465069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5717b-009c-41a9-abd8-3f368e1c3e1d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.465413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5717b-009c-41a9-abd8-3f368e1c3e1d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.465740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5717b-009c-41a9-abd8-3f368e1c3e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.466606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171472d-1afd-4fd5-a4e6-2ea0b3751ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.467848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171472d-1afd-4fd5-a4e6-2ea0b3751ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.468403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171472d-1afd-4fd5-a4e6-2ea0b3751ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.469329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171472d-1afd-4fd5-a4e6-2ea0b3751ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.480988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171472d-1afd-4fd5-a4e6-2ea0b3751ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.482619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171472d-1afd-4fd5-a4e6-2ea0b3751ac4 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.483711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-bcc5717b-009c-41a9-abd8-3f368e1c3e1d None None] MFA Rules not processed for user `4e4769e15ff54700be019d0b0dee5f64`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.484946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bcc5717b-009c-41a9-abd8-3f368e1c3e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.493798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 802/1617] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:36.495558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f456-ebd0-4127-98a4-6962b5cf34c2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.495863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f456-ebd0-4127-98a4-6962b5cf34c2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.496150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026f456-ebd0-4127-98a4-6962b5cf34c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.525061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c026f456-ebd0-4127-98a4-6962b5cf34c2 None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.526517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c026f456-ebd0-4127-98a4-6962b5cf34c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.555897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 816/1618] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.555897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5717b-009c-41a9-abd8-3f368e1c3e1d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.613462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 803/1619] 10.222.0.59 () {58 vars in 1058 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.615048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0629-7d6c-449d-87d9-f52a5b5775e6 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.615437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0629-7d6c-449d-87d9-f52a5b5775e6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.617076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0629-7d6c-449d-87d9-f52a5b5775e6 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.619004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 804/1620] 10.222.0.59 () {54 vars in 961 bytes} [Wed May 18 14:55:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:36.619782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0629-7d6c-449d-87d9-f52a5b5775e6 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.628296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5717b-009c-41a9-abd8-3f368e1c3e1d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.634093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.634852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.635213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.635566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.636339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.638308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.659826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 817/1621] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:36.661443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.673055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7eb1-ac53-4658-bb81-e6f5fe105cc6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.681264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.682348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.682637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.682924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.683627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.685829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.692465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0629-7d6c-449d-87d9-f52a5b5775e6 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.697954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.698625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.698909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.699192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.709469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.711161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.716323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 818/1622] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:36.719952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.722137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 805/1623] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:36.723012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.735656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cec0-e967-43b9-b3ff-9781f3fa9bee service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.754556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.769842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:36.797868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b60a6-5de0-4693-99ea-528455657d36 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.805308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c932-3ce1-4d61-87f3-fc9f7a01c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.806370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c932-3ce1-4d61-87f3-fc9f7a01c13b admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.808050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c932-3ce1-4d61-87f3-fc9f7a01c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.808419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c932-3ce1-4d61-87f3-fc9f7a01c13b admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.809133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c932-3ce1-4d61-87f3-fc9f7a01c13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.811869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c932-3ce1-4d61-87f3-fc9f7a01c13b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.823805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.825077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.825231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.825513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.836646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 819/1624] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:36.838212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15fc7-c9e8-426c-905f-73c39c4280ef None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.838716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15fc7-c9e8-426c-905f-73c39c4280ef None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.839179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15fc7-c9e8-426c-905f-73c39c4280ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.863777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-eca15fc7-c9e8-426c-905f-73c39c4280ef None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:36.865079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-eca15fc7-c9e8-426c-905f-73c39c4280ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:36.878894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 820/1625] 10.222.0.59 () {58 vars in 1058 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:36.880479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15fc7-c9e8-426c-905f-73c39c4280ef None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.894664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15fc7-c9e8-426c-905f-73c39c4280ef None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.901912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.902760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.903063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.903367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.904088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.906611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.907017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.909919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.925192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 821/1626] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:36.926513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.939647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 806/1627] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:36.940519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:36.941672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa85bb-c7af-4988-aa7a-4d309b72d69e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.947386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.948069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.948985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.949324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.950036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.952161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.959525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b449-8012-4fc4-935e-7a426ffb0e57 service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:36.968529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:36.969811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:36.970352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:36.970840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:36.973000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:36.983772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:36.985546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 822/1628] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:36 2022] POST /identity/v3/users => generated 300 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:36.987031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.009890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 807/1629] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:37.009890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.016669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15d3d-f293-463b-9e3a-eb63792994a4 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.030861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.032517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104e16-b3b8-4824-9289-1b29b743d895 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.033008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.033849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.033849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.043702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.044635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.044923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.045208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] PATH_INFO: `/v3/projects/5525b7d3b9ee4f72add465641978a29f/users/66e5f540102f4959a26447c56e65e4b7/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.079680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5525b7d3b9ee4f72add465641978a29f, user_id=66e5f540102f4959a26447c56e65e4b7, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.082849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.110021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 808/1630] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:37 2022] PUT /identity/v3/projects/5525b7d3b9ee4f72add465641978a29f/users/66e5f540102f4959a26447c56e65e4b7/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:37.113877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.174336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.179611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.219203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 823/1631] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:37.220198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9b180-5114-4d7b-8725-2849183f4583 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.220292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.225863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.226700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.227779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.228070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.228832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.231305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.245881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 809/1632] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:37.246799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.254529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b892-bff5-4add-bf01-2b61d2196ce2 service nova] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.260149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e16a91-62be-4e6a-a913-7d9178f26df9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.263527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.264621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.265171 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.265711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] PATH_INFO: `/v3/projects/6f1b416e8fdf420bbfd2584f42443286/users/5c9164228616458da3d2c1ea88e388ec/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.274931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.277812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.278196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.278928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.281357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.286024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.302866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:37.310551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1b416e8fdf420bbfd2584f42443286, user_id=5c9164228616458da3d2c1ea88e388ec, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.320971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.322928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 810/1633] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:37.324543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.343589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73321c22-be0b-4908-96dc-6b79957cd56e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.348636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 824/1634] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:37 2022] PUT /identity/v3/projects/6f1b416e8fdf420bbfd2584f42443286/users/5c9164228616458da3d2c1ea88e388ec/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:37.349546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.444447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abda16-74b9-4b22-9dbb-47a30f797fe7 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.457933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1a14-635a-422a-b9af-49e66c72b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.458852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1a14-635a-422a-b9af-49e66c72b1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.459138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1a14-635a-422a-b9af-49e66c72b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.459421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1a14-635a-422a-b9af-49e66c72b1fe admin admin] PATH_INFO: `/v3/projects/5525b7d3b9ee4f72add465641978a29f/users/66e5f540102f4959a26447c56e65e4b7/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.463123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67b03a-a1b1-4438-a59b-047fd487b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.464457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b03a-a1b1-4438-a59b-047fd487b714 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.464457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b03a-a1b1-4438-a59b-047fd487b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.464678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b03a-a1b1-4438-a59b-047fd487b714 admin admin] PATH_INFO: `/v3/projects/18aed2c3597d4211ae7931d471d9692c/users/54c9442dac214561a145b0ca3f08349e/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.466727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1a14-635a-422a-b9af-49e66c72b1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5525b7d3b9ee4f72add465641978a29f, user_id=66e5f540102f4959a26447c56e65e4b7, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.471243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1a14-635a-422a-b9af-49e66c72b1fe admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.488952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:37.494749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 825/1635] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:37 2022] PUT /identity/v3/projects/5525b7d3b9ee4f72add465641978a29f/users/66e5f540102f4959a26447c56e65e4b7/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:37.506679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67b03a-a1b1-4438-a59b-047fd487b714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18aed2c3597d4211ae7931d471d9692c, user_id=54c9442dac214561a145b0ca3f08349e, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.509615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67b03a-a1b1-4438-a59b-047fd487b714 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.513441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054950-9740-4462-adf9-562dcb60d32c None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.515548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054950-9740-4462-adf9-562dcb60d32c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.515548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054950-9740-4462-adf9-562dcb60d32c None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.519615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 826/1636] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 18 14:55:37 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:37.520546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054950-9740-4462-adf9-562dcb60d32c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.541982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 811/1637] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:37 2022] PUT /identity/v3/projects/18aed2c3597d4211ae7931d471d9692c/users/54c9442dac214561a145b0ca3f08349e/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:37.543252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a7c3-21ab-4a60-9b44-5da012c802a2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.543548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a7c3-21ab-4a60-9b44-5da012c802a2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.543833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a7c3-21ab-4a60-9b44-5da012c802a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.601734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9c15a7c3-21ab-4a60-9b44-5da012c802a2 None None] MFA Rules not processed for user `66e5f540102f4959a26447c56e65e4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:37.603016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9c15a7c3-21ab-4a60-9b44-5da012c802a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:37.635955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054950-9740-4462-adf9-562dcb60d32c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.745922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 812/1638] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:37.747345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd461a-f334-4dee-8460-3caf6087b80a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.747627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd461a-f334-4dee-8460-3caf6087b80a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.747909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd461a-f334-4dee-8460-3caf6087b80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.756080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.756792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.758644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.758938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.759690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.763796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.793406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 827/1639] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:37.793406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.794798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-17cd461a-f334-4dee-8460-3caf6087b80a None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:37.796656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-17cd461a-f334-4dee-8460-3caf6087b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:37.818197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f616e8-346d-4554-a920-84873c47e36f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:37.830214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0d461-d3cd-43a7-a65b-195b6cfa6874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:37.830909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d461-d3cd-43a7-a65b-195b6cfa6874 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.831197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d461-d3cd-43a7-a65b-195b6cfa6874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.831479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d461-d3cd-43a7-a65b-195b6cfa6874 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.832221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0d461-d3cd-43a7-a65b-195b6cfa6874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:37.839905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0d461-d3cd-43a7-a65b-195b6cfa6874 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:37.861703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 828/1640] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:37.867831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc24bb-3f77-45de-9556-a07daf67c445 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:37.868185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc24bb-3f77-45de-9556-a07daf67c445 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:37.868400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc24bb-3f77-45de-9556-a07daf67c445 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:37.881407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 829/1641] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 18 14:55:37 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:37.883328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc24bb-3f77-45de-9556-a07daf67c445 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:37.953471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:37.975430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 813/1642] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:37.978671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd461a-f334-4dee-8460-3caf6087b80a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:38.001898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd461a-f334-4dee-8460-3caf6087b80a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:38.005854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc24bb-3f77-45de-9556-a07daf67c445 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:38.013482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:38.016868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.017110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.017263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405c84c-bafe-4055-9049-1eb2eb8aad6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:38.018083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405c84c-bafe-4055-9049-1eb2eb8aad6f service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.018664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] PATH_INFO: `/v3/projects/6f1b416e8fdf420bbfd2584f42443286/users/5c9164228616458da3d2c1ea88e388ec/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.019820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405c84c-bafe-4055-9049-1eb2eb8aad6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.020101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405c84c-bafe-4055-9049-1eb2eb8aad6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.022222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1b416e8fdf420bbfd2584f42443286, user_id=5c9164228616458da3d2c1ea88e388ec, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:38.024980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:38.039129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405c84c-bafe-4055-9049-1eb2eb8aad6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:38.040482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405c84c-bafe-4055-9049-1eb2eb8aad6f service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:38.052066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 814/1643] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:37 2022] PUT /identity/v3/projects/6f1b416e8fdf420bbfd2584f42443286/users/5c9164228616458da3d2c1ea88e388ec/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:38.052841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:38.076843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 830/1644] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:38.078824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afe19-3418-4301-9582-507c5c27af96 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.079169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afe19-3418-4301-9582-507c5c27af96 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.080610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afe19-3418-4301-9582-507c5c27af96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.139559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c46afe19-3418-4301-9582-507c5c27af96 None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:38.142073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c46afe19-3418-4301-9582-507c5c27af96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:38.192298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b13e99-1ba9-4496-b239-c5fd707e4af7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:38.216473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:38.217507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.217864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.218212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] PATH_INFO: `/v3/projects/18aed2c3597d4211ae7931d471d9692c/users/54c9442dac214561a145b0ca3f08349e/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.220391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:38.221022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18aed2c3597d4211ae7931d471d9692c, user_id=54c9442dac214561a145b0ca3f08349e, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:38.225225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:38.251874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 815/1645] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:38 2022] PUT /identity/v3/projects/18aed2c3597d4211ae7931d471d9692c/users/54c9442dac214561a145b0ca3f08349e/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:38.253196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:38.309067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 831/1646] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:38.316162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e2a5-4782-4cf5-8212-49329179d36b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.316806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e2a5-4782-4cf5-8212-49329179d36b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.317548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e2a5-4782-4cf5-8212-49329179d36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.355830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545d931-4c0f-4568-8eb3-aeec5cb112f9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:38.360118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:38.360929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.361334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.361718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.361974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e1e4e2a5-4782-4cf5-8212-49329179d36b None None] MFA Rules not processed for user `5c9164228616458da3d2c1ea88e388ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:38.363983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e1e4e2a5-4782-4cf5-8212-49329179d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:38.463317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:38.464817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:38.478544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 816/1647] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:38.479447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:38.494564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7757c1f-fdfa-4405-9402-f3660a2dbbbe service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:38.503143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 832/1648] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:38.505172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bad5f4-1c5c-49e8-81be-31f4c976e653 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.507802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bad5f4-1c5c-49e8-81be-31f4c976e653 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.508458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bad5f4-1c5c-49e8-81be-31f4c976e653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.510826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:38.511506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:38.511786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:38.512061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:38.548627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:38.578346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a6bad5f4-1c5c-49e8-81be-31f4c976e653 None None] MFA Rules not processed for user `54c9442dac214561a145b0ca3f08349e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:38.584912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a6bad5f4-1c5c-49e8-81be-31f4c976e653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:38.648506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:38.650012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:38.696460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 817/1649] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:38.717830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 833/1650] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:39.338117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:39.353819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7458d-e320-4feb-a26b-790b2eb214a9 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:39.373084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:39.373771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:39.374053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:39.374330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:39.401845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:39.403701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:39.417577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bad5f4-1c5c-49e8-81be-31f4c976e653 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:39.435853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 818/1651] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:39.437199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bad5f4-1c5c-49e8-81be-31f4c976e653 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:39.445312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:39.446030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:39.446347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:39.446639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:39.473211 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:39.477517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:39.513370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 834/1652] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:55:39.634883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:39.658026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd466f-9493-4b82-82fe-2ad8a34762d3 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:39.668086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:39.668884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:39.669307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:39.669593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:39.681848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:39.684445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:39.704206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 819/1653] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:39.757649 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:39.837072 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:39.957329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8340b-e80d-40fd-9a45-ab22a48661b4 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:39.989390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:39.990317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:39.990617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:39.990904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] PATH_INFO: `/v3/users/23055a6dbcae4f7ca7a3db94d82a10eb` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:39.993973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23055a6dbcae4f7ca7a3db94d82a10eb)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:39.997557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: WARNING py.warnings [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:55:39.997557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: warnings.warn(msg) May 18 14:55:39.997557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: May 18 14:55:39.999262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:40.049313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:40.094327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe93c1-26f6-4b36-86be-ee33f3c423ff service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:40.128470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:40.132938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:40.133169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:40.133705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:40.180920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23055a6dbcae4f7ca7a3db94d82a10eb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:40.230118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23055a6dbcae4f7ca7a3db94d82a10eb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:40.312330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23055a6dbcae4f7ca7a3db94d82a10eb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:40.314245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23055a6dbcae4f7ca7a3db94d82a10eb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:40.317523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:40.318282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5ec50973-af38-49ac-b715-1eb9641e3b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23055a6dbcae4f7ca7a3db94d82a10eb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:40.320693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:40.367469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 835/1654] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:55:39 2022] DELETE /identity/v3/users/23055a6dbcae4f7ca7a3db94d82a10eb => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:40.367763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 820/1655] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:55:40.369446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:40.372054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:40.372444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:40.427867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:40.431475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:40.440778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:40.453267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44e2a-1a7d-4157-8417-9f88ab61ac96 service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:40.550778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 836/1656] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:40.597215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89627fd-dece-4d46-b11b-560d7c22d768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:40.597816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89627fd-dece-4d46-b11b-560d7c22d768 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:40.598106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89627fd-dece-4d46-b11b-560d7c22d768 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:40.598502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89627fd-dece-4d46-b11b-560d7c22d768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:40.615978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b89627fd-dece-4d46-b11b-560d7c22d768 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:40.737247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:40.759306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89627fd-dece-4d46-b11b-560d7c22d768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:40.762666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89627fd-dece-4d46-b11b-560d7c22d768 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:40.780767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 821/1657] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:40.797317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:40.799188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:40.971996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:41.005224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d4099-f361-41d1-b7b5-0b8eab1fda7a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:41.018156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85357c39-4457-4ba2-b96e-30cbcc9ff91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:41.020441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357c39-4457-4ba2-b96e-30cbcc9ff91f service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:41.020868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357c39-4457-4ba2-b96e-30cbcc9ff91f service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:41.021312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85357c39-4457-4ba2-b96e-30cbcc9ff91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:41.058512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85357c39-4457-4ba2-b96e-30cbcc9ff91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:41.066390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85357c39-4457-4ba2-b96e-30cbcc9ff91f service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:41.111305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 837/1658] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:41.910966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280144-805f-461d-a323-aeaf98becdc1 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:41.911884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280144-805f-461d-a323-aeaf98becdc1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:41.912341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280144-805f-461d-a323-aeaf98becdc1 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:41.914458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 822/1659] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 18 14:55:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:41.927395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:41.928573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:41.929543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:42.043385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] MFA Rules not processed for user `1aa975bb70624500aa802e7a708014c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:42.047210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:42.069218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 838/1660] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:42.105147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb280144-805f-461d-a323-aeaf98becdc1 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:42.107629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bb280144-805f-461d-a323-aeaf98becdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:42.132224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb280144-805f-461d-a323-aeaf98becdc1 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:42.137250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:42.138639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:42.139100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:42.139522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:42.172900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:42.179588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:42.212681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 823/1661] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:42.246982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:42.248448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:42.282987 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635f896-25dc-4d74-9d02-a57dd52cbb6a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:42.301095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:42.307090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:42.310868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:42.311270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] PATH_INFO: `/v3/projects/40e4e55c987d45fcb8a292f34b2f6ac3` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:42.314689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e4e55c987d45fcb8a292f34b2f6ac3)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:42.316736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:42.481046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e4e55c987d45fcb8a292f34b2f6ac3', 'request_id': 'req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.489407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e4e55c987d45fcb8a292f34b2f6ac3', 'request_id': 'req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.509966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e4e55c987d45fcb8a292f34b2f6ac3', 'request_id': 'req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.541338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] The token cache is being invalidate because project 40e4e55c987d45fcb8a292f34b2f6ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:55:42.541714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.542569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a60e8776-a97b-4c03-aaf1-f1c2ff055b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.544524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 839/1662] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:55:42 2022] DELETE /identity/v3/projects/40e4e55c987d45fcb8a292f34b2f6ac3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:42.548552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:42.568978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97986d-6a12-49a8-b867-c80fc8c526e3 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:42.816127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:42.817068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:42.817502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:42.817819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] PATH_INFO: `/v3/users/54c9442dac214561a145b0ca3f08349e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:42.819534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c9442dac214561a145b0ca3f08349e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:42.821550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:42.952296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c9442dac214561a145b0ca3f08349e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.953973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c9442dac214561a145b0ca3f08349e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.973387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c9442dac214561a145b0ca3f08349e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.984390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c9442dac214561a145b0ca3f08349e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:42.985495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ea1fa94a-28f3-487b-8f3b-6fe002c3e207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c9442dac214561a145b0ca3f08349e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:43.007236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 824/1663] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:55:42 2022] DELETE /identity/v3/users/54c9442dac214561a145b0ca3f08349e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:43.381394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f309f-7ad1-4332-9bb9-f7af7a4eeb00 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:43.381907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f309f-7ad1-4332-9bb9-f7af7a4eeb00 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:43.382251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f309f-7ad1-4332-9bb9-f7af7a4eeb00 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:43.383900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 840/1664] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 18 14:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:43.401393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:43.402012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:43.402490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:43.454804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] MFA Rules not processed for user `c316d4242edf4c82afd982127603827c`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:43.464454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:43.734880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:43.784133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f309f-7ad1-4332-9bb9-f7af7a4eeb00 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:43.787968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 825/1665] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 18 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:43.852543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f309f-7ad1-4332-9bb9-f7af7a4eeb00 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:43.861734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:43.864105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:43.874771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716e28b-1746-481b-af5e-318ed33b3515 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:43.876879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716e28b-1746-481b-af5e-318ed33b3515 service placement] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:43.878990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716e28b-1746-481b-af5e-318ed33b3515 service placement] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:43.879351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716e28b-1746-481b-af5e-318ed33b3515 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:43.900295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a716e28b-1746-481b-af5e-318ed33b3515 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:43.962153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716e28b-1746-481b-af5e-318ed33b3515 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:43.964345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716e28b-1746-481b-af5e-318ed33b3515 service placement] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:43.990060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 841/1666] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:44.002602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a0674-ca27-435a-b5c6-08ef134b1533 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:44.030510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:44.032545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:44.033115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:44.033611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] PATH_INFO: `/v3/projects/18aed2c3597d4211ae7931d471d9692c` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:44.046049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18aed2c3597d4211ae7931d471d9692c)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:44.047474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: WARNING py.warnings [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:55:44.047474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: warnings.warn(msg) May 18 14:55:44.047474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: May 18 14:55:44.049143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:44.173612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18aed2c3597d4211ae7931d471d9692c', 'request_id': 'req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:44.193150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18aed2c3597d4211ae7931d471d9692c', 'request_id': 'req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:44.198851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18aed2c3597d4211ae7931d471d9692c', 'request_id': 'req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:44.223888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] The token cache is being invalidate because project 18aed2c3597d4211ae7931d471d9692c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:55:44.225199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:44.227027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-d7d05b58-bed3-4fe1-8b1b-71fd0d1d9b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:44.229017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 826/1667] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:55:43 2022] DELETE /identity/v3/projects/18aed2c3597d4211ae7931d471d9692c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:44.233592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d89a-8155-4e77-a30f-c4cf79694a4e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:44.234214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d89a-8155-4e77-a30f-c4cf79694a4e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:44.234747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d89a-8155-4e77-a30f-c4cf79694a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:44.263922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:44.264301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:44.264718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:44.288895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1ad1d89a-8155-4e77-a30f-c4cf79694a4e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:44.291138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1ad1d89a-8155-4e77-a30f-c4cf79694a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:44.352059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] MFA Rules not processed for user `25784e3193b047ecaa6788bd79611f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:44.357854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:44.398775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 842/1668] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:55:44.406456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd678-bbce-481c-8cae-59ab6d643d62 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:44.406755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd678-bbce-481c-8cae-59ab6d643d62 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:44.407202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd678-bbce-481c-8cae-59ab6d643d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:44.454876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-977cd678-bbce-481c-8cae-59ab6d643d62 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:44.457069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-977cd678-bbce-481c-8cae-59ab6d643d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:44.492038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 843/1669] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:55:44.493034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cd678-bbce-481c-8cae-59ab6d643d62 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:44.502422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 827/1670] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:44.506899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cd678-bbce-481c-8cae-59ab6d643d62 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:44.512330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:44.513372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:44.513664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:44.514126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:44.514882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:44.515197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:44.517368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:44.528216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:44.529922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:44.543025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 844/1671] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:44.550535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:44.552748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:44.579406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc416e-54e7-4021-8097-42d2f318a2ae admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:44.597723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:44.598415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:44.598705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:44.602087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:44.604103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:44.608305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:44.710923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637f2b5-73b9-4ce1-8597-ad310d374a39 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:44.741007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:44.741385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:44.741675 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:44.741963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:44.754536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:44.758773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:44.805146 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 828/1672] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:44.834632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:44.861524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 845/1673] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:44 2022] POST /identity/v3/projects => generated 379 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:44.863703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:44.897002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46f58-ac27-4efb-9a5e-5cfb601fd44f service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:45.057516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:45.058216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:45.058509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:45.058795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:45.059718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:45.061712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:45.110728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 829/1674] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:44 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:45.110930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:45.123293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ee683-dbbf-4b69-92d8-cc9e9162af6a admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:45.128410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:45.129247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:45.129635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:45.130116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:45.130858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:45.133777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:45.151866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 846/1675] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:55:45.152746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:45.166067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ab98-e0f7-40b4-b2f7-d2981604857c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:45.173952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0415358-ebec-402e-a4f9-6893a87ebaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:45.175005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0415358-ebec-402e-a4f9-6893a87ebaee admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:45.175362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0415358-ebec-402e-a4f9-6893a87ebaee admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:45.189112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0415358-ebec-402e-a4f9-6893a87ebaee admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:45.190552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0415358-ebec-402e-a4f9-6893a87ebaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:45.193823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0415358-ebec-402e-a4f9-6893a87ebaee admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:45.234427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 830/1676] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:55:45.238383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:45.258067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0997b8a-2205-41d3-9183-b8a1f725d512 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:45.273392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:45.276212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:45.276528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:45.276805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] PATH_INFO: `/v3/projects/4e694f6ed94243b2849c90dbd04e1565/users/ffd3e568779946528c7fa4dcdc0eeef3/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:45.321389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e694f6ed94243b2849c90dbd04e1565, user_id=ffd3e568779946528c7fa4dcdc0eeef3, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:45.324286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:45.357556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 847/1677] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:45 2022] PUT /identity/v3/projects/4e694f6ed94243b2849c90dbd04e1565/users/ffd3e568779946528c7fa4dcdc0eeef3/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:45.359323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48f1f9-e5e3-4cc0-86f4-af1a2b950553 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:45.359626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48f1f9-e5e3-4cc0-86f4-af1a2b950553 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:45.359955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48f1f9-e5e3-4cc0-86f4-af1a2b950553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:45.438627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1d48f1f9-e5e3-4cc0-86f4-af1a2b950553 None None] MFA Rules not processed for user `ffd3e568779946528c7fa4dcdc0eeef3`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:45.439863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1d48f1f9-e5e3-4cc0-86f4-af1a2b950553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:45.594353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:45.595409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 831/1678] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:55:45.720683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9854-d584-4e64-a467-661d479ea211 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:45.730129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:45.732399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:45.733065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:45.733556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:45.734536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:45.736659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:45.815684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 848/1679] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:45 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:45.820418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48f1f9-e5e3-4cc0-86f4-af1a2b950553 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:45.826375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:45.838679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48f1f9-e5e3-4cc0-86f4-af1a2b950553 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:45.963091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:45.963574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:45.964119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:45.964406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:45.967389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:45.970107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:46.048227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:46.055991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 832/1680] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:45 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:46.063634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c972-2f27-4201-985f-110d6c927479 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:46.094697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:46.100672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:46.101100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:46.101393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:46.104775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:46.110817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:46.142212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:46.156072 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 849/1681] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:46.170153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8274-5e53-4798-850c-48ec6622533b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:46.182940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:46.183954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:46.184247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:46.184526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] PATH_INFO: `/v3/projects/9d02e1661a10457c9f4a52545866019f/users/cde2da401816431b90ae4386a8005130/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:46.226986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d02e1661a10457c9f4a52545866019f, user_id=cde2da401816431b90ae4386a8005130, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:46.229846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:46.269632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:46.269851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 833/1682] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:46 2022] PUT /identity/v3/projects/9d02e1661a10457c9f4a52545866019f/users/cde2da401816431b90ae4386a8005130/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:46.287652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f751506-26bb-4d56-8867-a57b08b4c87c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:46.466158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77569725-0199-4910-af6e-21c2bc754eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:46.466854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77569725-0199-4910-af6e-21c2bc754eae admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:46.467707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77569725-0199-4910-af6e-21c2bc754eae admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:46.468568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77569725-0199-4910-af6e-21c2bc754eae admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:46.469667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77569725-0199-4910-af6e-21c2bc754eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:46.476865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77569725-0199-4910-af6e-21c2bc754eae admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:46.502123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 850/1683] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:46.505425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:46.520034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61969838-2731-4922-b2ff-c997750a9809 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:46.526556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:46.527995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:46.528660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:46.529069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] PATH_INFO: `/v3/projects/9d02e1661a10457c9f4a52545866019f/users/cde2da401816431b90ae4386a8005130/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:46.531438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d02e1661a10457c9f4a52545866019f, user_id=cde2da401816431b90ae4386a8005130, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:46.534601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:46.562589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 834/1684] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:46 2022] PUT /identity/v3/projects/9d02e1661a10457c9f4a52545866019f/users/cde2da401816431b90ae4386a8005130/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:46.563323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:46.563768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:46.564123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:46.623026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] MFA Rules not processed for user `cde2da401816431b90ae4386a8005130`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:46.625215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:46.661414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:46.748543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 851/1685] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:46.759600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:46.761475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:46.896446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f869cbb-713b-45d1-b228-e3a4f4ac9f2c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:46.902925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b8e5d-801a-48e7-b59c-b1c6683298cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:46.904639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8e5d-801a-48e7-b59c-b1c6683298cd service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:46.905076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8e5d-801a-48e7-b59c-b1c6683298cd service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:46.905499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8e5d-801a-48e7-b59c-b1c6683298cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:46.919810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b8e5d-801a-48e7-b59c-b1c6683298cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:46.922894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b8e5d-801a-48e7-b59c-b1c6683298cd service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:46.943843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 835/1686] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:47.111271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:47.116327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:47.142014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049590b1-4fdf-4fd7-81a8-f4197248f134 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:47.153999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcc234-79ac-4911-bdc6-e856889dc6b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:47.154848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcc234-79ac-4911-bdc6-e856889dc6b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:47.155240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcc234-79ac-4911-bdc6-e856889dc6b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:47.155626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcc234-79ac-4911-bdc6-e856889dc6b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:47.275595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcc234-79ac-4911-bdc6-e856889dc6b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:47.277131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcc234-79ac-4911-bdc6-e856889dc6b8 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:47.305109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 852/1687] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:47.425199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:47.425733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:47.425924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:47.477044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] MFA Rules not processed for user `2aa34e012c824754833a12ac66413aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:47.478874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:47.618866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:47.671012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 836/1688] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:47.682394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411092-9f27-46d7-9c92-061272aaf5a1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:47.682920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411092-9f27-46d7-9c92-061272aaf5a1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:47.683046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02411092-9f27-46d7-9c92-061272aaf5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:47.724534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-02411092-9f27-46d7-9c92-061272aaf5a1 None None] MFA Rules not processed for user `2aa34e012c824754833a12ac66413aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:47.726437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-02411092-9f27-46d7-9c92-061272aaf5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:47.749195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 853/1689] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:47.766923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:47.773703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:47.962968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb68f5-387b-457b-a6e1-5a253305d5b7 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:47.990942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f778be-8e49-4c7e-bcc7-8c8114de529c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:47.991730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f778be-8e49-4c7e-bcc7-8c8114de529c service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:47.992199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f778be-8e49-4c7e-bcc7-8c8114de529c service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:47.992474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f778be-8e49-4c7e-bcc7-8c8114de529c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:48.008507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f778be-8e49-4c7e-bcc7-8c8114de529c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:48.010437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f778be-8e49-4c7e-bcc7-8c8114de529c service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:48.031386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 837/1690] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:48.201392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40898-8d55-418b-a116-aac223cd1a42 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:48.201988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40898-8d55-418b-a116-aac223cd1a42 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:48.202496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40898-8d55-418b-a116-aac223cd1a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:48.244298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c2d40898-8d55-418b-a116-aac223cd1a42 None None] MFA Rules not processed for user `25784e3193b047ecaa6788bd79611f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:48.246886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c2d40898-8d55-418b-a116-aac223cd1a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:48.467603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 854/1691] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:49.733663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767a6a2-1e4d-4912-8959-f8e579bc58fe None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:49.735147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767a6a2-1e4d-4912-8959-f8e579bc58fe None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:49.735147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767a6a2-1e4d-4912-8959-f8e579bc58fe None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:49.736040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 838/1692] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 18 14:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:49.745376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851198e7-b2fb-4c29-a8ba-3fcd5aae4485 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:49.745922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851198e7-b2fb-4c29-a8ba-3fcd5aae4485 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:49.746578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851198e7-b2fb-4c29-a8ba-3fcd5aae4485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:49.785977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-851198e7-b2fb-4c29-a8ba-3fcd5aae4485 None None] MFA Rules not processed for user `1aa975bb70624500aa802e7a708014c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:49.790079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-851198e7-b2fb-4c29-a8ba-3fcd5aae4485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:49.921702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 855/1693] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:49.934326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767a6a2-1e4d-4912-8959-f8e579bc58fe None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:49.938448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6767a6a2-1e4d-4912-8959-f8e579bc58fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:49.963620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767a6a2-1e4d-4912-8959-f8e579bc58fe None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:49.982836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:49.983961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:49.984524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:49.985785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:50.004411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:50.006109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:50.054441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 839/1694] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:50.102232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:50.102528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:50.102810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:50.111238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:50.162737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:50.175692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:50.355597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 856/1695] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:50.576406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:50.580351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:50.681043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:50.683043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:50.701474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a3c5-4de5-4379-a0eb-518caaf236c2 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:50.721971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:50.723232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:50.723595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:50.726335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] PATH_INFO: `/v3/users/476a193861874fcbb7bff6038bb02ee4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:50.729016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=476a193861874fcbb7bff6038bb02ee4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:50.739024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:50.875816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34769c5-9629-4280-8a6d-f58cc52f59ed None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:50.883300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476a193861874fcbb7bff6038bb02ee4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:50.884285 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476a193861874fcbb7bff6038bb02ee4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:50.892625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a2796-2504-4875-8e8c-950fc3956500 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:50.898174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a2796-2504-4875-8e8c-950fc3956500 service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:50.899068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a2796-2504-4875-8e8c-950fc3956500 service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:50.900610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a2796-2504-4875-8e8c-950fc3956500 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:50.906286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fd9a2796-2504-4875-8e8c-950fc3956500 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:50.948697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:50.952369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476a193861874fcbb7bff6038bb02ee4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:50.969812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a2796-2504-4875-8e8c-950fc3956500 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:50.971817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a2796-2504-4875-8e8c-950fc3956500 service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:50.985786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476a193861874fcbb7bff6038bb02ee4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:50.986688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476a193861874fcbb7bff6038bb02ee4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:51.026511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 840/1696] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:55:50 2022] DELETE /identity/v3/users/476a193861874fcbb7bff6038bb02ee4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:51.028260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:51.032397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 857/1697] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:55:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 14:55:51.033979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:51.036508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb514-2463-4b69-8e01-17ae84dda684 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:51.037063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb514-2463-4b69-8e01-17ae84dda684 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:51.037560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fb514-2463-4b69-8e01-17ae84dda684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:51.121962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f87fb514-2463-4b69-8e01-17ae84dda684 None None] MFA Rules not processed for user `2aa34e012c824754833a12ac66413aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:51.168469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f87fb514-2463-4b69-8e01-17ae84dda684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:51.386571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eccd4-760d-4599-8e2a-588faf345a9f admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:51.406597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:51.408143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:51.411832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:51.414031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] PATH_INFO: `/v3/users/ffd3e568779946528c7fa4dcdc0eeef3` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:51.418838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd3e568779946528c7fa4dcdc0eeef3)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:51.427161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:51.541386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 858/1698] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:51.549043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:51.549506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:51.549907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:51.604237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:51.607076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:51.672359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 859/1699] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:51.718133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd3e568779946528c7fa4dcdc0eeef3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:51.720617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd3e568779946528c7fa4dcdc0eeef3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:51.736297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:51.738055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:51.763438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd3e568779946528c7fa4dcdc0eeef3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:51.788547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd3e568779946528c7fa4dcdc0eeef3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:51.792387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0e9b9f1e-abcf-49ae-a959-96a4fb50c331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd3e568779946528c7fa4dcdc0eeef3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:51.862910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 841/1700] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:55:51 2022] DELETE /identity/v3/users/ffd3e568779946528c7fa4dcdc0eeef3 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:51.867539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:51.868254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:51.869082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:51.893536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:51.927691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:51.930930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:51.981255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d802341-06d1-4512-93d9-52563333aa96 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:52.170169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05533540-815f-4d75-80c6-629fe1e5d9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:52.170826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533540-815f-4d75-80c6-629fe1e5d9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:52.171304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:52.173174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533540-815f-4d75-80c6-629fe1e5d9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:52.174482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533540-815f-4d75-80c6-629fe1e5d9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:52.199586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-05533540-815f-4d75-80c6-629fe1e5d9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:52.206453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 842/1701] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:52.265564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05533540-815f-4d75-80c6-629fe1e5d9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:52.269317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05533540-815f-4d75-80c6-629fe1e5d9b5 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:52.306036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:52.307639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:52.310355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 860/1702] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:52.345964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedbe8a-9152-455d-97f3-ca53333d8af8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:52.374818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:52.375529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:52.375815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:52.376094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:52.414088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:52.415846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:52.444221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 843/1703] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:53.185571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:53.186054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:53.186260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:53.202813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:53.202813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:53.243177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] MFA Rules not processed for user `1aa975bb70624500aa802e7a708014c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:53.245162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:53.248299 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b9910-3748-461c-86e8-2c7569b60fc1 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:53.266590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 861/1704] 10.222.0.49 () {58 vars in 1015 bytes} [Wed May 18 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:53.279584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:53.280638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:53.281114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:53.281386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] PATH_INFO: `/v3/projects/b4890d7d8a4c4f129840f48d5fb6b405` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:53.284866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4890d7d8a4c4f129840f48d5fb6b405)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:53.293512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:53.327822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:53.333232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:53.388631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e65821-7b35-4e64-be98-cf17ac733792 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:53.406939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaab3f9-2829-4729-80f3-9376d35beaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:53.410019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab3f9-2829-4729-80f3-9376d35beaaa service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:53.410404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab3f9-2829-4729-80f3-9376d35beaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:53.411485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaab3f9-2829-4729-80f3-9376d35beaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:53.439516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaab3f9-2829-4729-80f3-9376d35beaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:53.443513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaab3f9-2829-4729-80f3-9376d35beaaa service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:53.475878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 862/1705] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:55:53.487813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4890d7d8a4c4f129840f48d5fb6b405', 'request_id': 'req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:53.514882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4890d7d8a4c4f129840f48d5fb6b405', 'request_id': 'req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:53.538888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4890d7d8a4c4f129840f48d5fb6b405', 'request_id': 'req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:53.589119 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] The token cache is being invalidate because project b4890d7d8a4c4f129840f48d5fb6b405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:55:53.589529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:53.590626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ba85eaa1-42ab-4d1f-84bf-3c1b5a517b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:53.597869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 844/1706] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:55:53 2022] DELETE /identity/v3/projects/b4890d7d8a4c4f129840f48d5fb6b405 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:53.599711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5004-cef9-4298-804e-07454353e3a9 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:53.600814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5004-cef9-4298-804e-07454353e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:53.601742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5004-cef9-4298-804e-07454353e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:53.702294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a3eb5004-cef9-4298-804e-07454353e3a9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:53.709179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a3eb5004-cef9-4298-804e-07454353e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:53.973409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 863/1707] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:53.981080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a3853-ecd1-457c-9492-c77000d7ca47 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:53.981484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a3853-ecd1-457c-9492-c77000d7ca47 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:53.981996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a3853-ecd1-457c-9492-c77000d7ca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:54.013782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a08a3853-ecd1-457c-9492-c77000d7ca47 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:54.019179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a08a3853-ecd1-457c-9492-c77000d7ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:54.042188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 845/1708] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:54.046543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5004-cef9-4298-804e-07454353e3a9 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:54.059993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5004-cef9-4298-804e-07454353e3a9 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:54.066418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:54.067241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:54.067630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:54.078764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:54.079785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:55:54.080205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:54.083532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:54.142131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 864/1709] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:55:54.145209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a3853-ecd1-457c-9492-c77000d7ca47 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:54.158550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a3853-ecd1-457c-9492-c77000d7ca47 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:54.165026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:54.166440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:54.166653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:54.167032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:54.169554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:54.172221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:54.245861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 846/1710] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:55:54 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:55:54.250344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:54.273974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ecc3c-365d-4e7f-ad49-f553c7501a66 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:54.435587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:54.437758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:54.650167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:54.650927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:54.651284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:54.651564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:54.659704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:54.667258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:54.694279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:54.748322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 865/1711] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:55:54 2022] POST /identity/v3/users => generated 288 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:55:54.764264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eadfd6-598c-4e16-87d0-51c44a47383d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:54.772064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:54.783999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:54.808722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:54.815086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:54.816255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:54.818166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] PATH_INFO: `/v3/projects/4e694f6ed94243b2849c90dbd04e1565` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:54.824449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e694f6ed94243b2849c90dbd04e1565)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:54.829560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:54.836783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd80a9d-46b9-4d1d-acf4-96bdc1fa0a76 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:54.852187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:54.855219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:54.855607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:54.855905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] PATH_INFO: `/v3/users/25967732542c4a28a38b1b8a121037f1` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:54.859556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25967732542c4a28a38b1b8a121037f1)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:54.877895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:55.032548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:55.106079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e694f6ed94243b2849c90dbd04e1565', 'request_id': 'req-93aa3df2-27ce-43bd-95e5-6166157df9a5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.123755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25967732542c4a28a38b1b8a121037f1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.151204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25967732542c4a28a38b1b8a121037f1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.154867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e694f6ed94243b2849c90dbd04e1565', 'request_id': 'req-93aa3df2-27ce-43bd-95e5-6166157df9a5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.182870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25967732542c4a28a38b1b8a121037f1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.187410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25967732542c4a28a38b1b8a121037f1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.192933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25967732542c4a28a38b1b8a121037f1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.212724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e694f6ed94243b2849c90dbd04e1565', 'request_id': 'req-93aa3df2-27ce-43bd-95e5-6166157df9a5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.250841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 866/1712] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:55:54 2022] DELETE /identity/v3/users/25967732542c4a28a38b1b8a121037f1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:55.258824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:55.264391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:55.311356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] The token cache is being invalidate because project 4e694f6ed94243b2849c90dbd04e1565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:55:55.325253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.328296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-93aa3df2-27ce-43bd-95e5-6166157df9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.341325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 847/1713] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:55:54 2022] DELETE /identity/v3/projects/4e694f6ed94243b2849c90dbd04e1565 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:55:55.342914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:55.343112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:55.351679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:55.443541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:55.445743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:55.542401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1277-4078-4ca6-bfd4-8a88c4458f3f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:55.571207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:55.571419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:55.572741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:55.573041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:55.573813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:55.580436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:55.611800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 867/1714] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:55.625481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:55.639039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:55.674619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f875e7-8f31-437e-9d46-e841c4f87e88 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:55.693618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:55.694490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:55.694881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:55.696906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] PATH_INFO: `/v3/users/cde2da401816431b90ae4386a8005130` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:55.698421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde2da401816431b90ae4386a8005130)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:55.719094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:55.734541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 848/1715] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:55.735259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:55.747864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:55.805962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc4432-41ea-4a56-9770-4ff3017d5f4a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:55.839125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:55.842507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:55.843871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:55.843871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:55.847320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:55.853976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:55.881545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde2da401816431b90ae4386a8005130'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.888900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:INSERT=3,keystone:SELECT=80,keystone:DELETE=17 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:55.893441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde2da401816431b90ae4386a8005130'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.912546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 849/1716] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:55:55.918225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:55.929350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde2da401816431b90ae4386a8005130'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.929350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde2da401816431b90ae4386a8005130'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.929350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde2da401816431b90ae4386a8005130'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:55.929671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:55.976376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 868/1717] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:55:55 2022] DELETE /identity/v3/users/cde2da401816431b90ae4386a8005130 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:55.977005 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:55.981441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:56.244089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba54e3-4615-48d7-aa27-813a376e09de admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:56.258861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1520b-e577-4199-9b12-6713c9822432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:56.260736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1520b-e577-4199-9b12-6713c9822432 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:56.261312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1520b-e577-4199-9b12-6713c9822432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:56.262610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1520b-e577-4199-9b12-6713c9822432 admin admin] PATH_INFO: `/v3/projects/2650835410cd4b8fb7c14b0c6f075729/users/430b8a27f45148c2a98985e1f1d37c14/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:56.301113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e55689-441c-49de-aca2-ded510ecc898 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:56.314095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1520b-e577-4199-9b12-6713c9822432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2650835410cd4b8fb7c14b0c6f075729, user_id=430b8a27f45148c2a98985e1f1d37c14, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:56.317986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1520b-e577-4199-9b12-6713c9822432 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:56.356946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 869/1718] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:55:55 2022] PUT /identity/v3/projects/2650835410cd4b8fb7c14b0c6f075729/users/430b8a27f45148c2a98985e1f1d37c14/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:56.360385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1a03-48ca-4813-9efb-b8b06e3c727c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:56.361655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1a03-48ca-4813-9efb-b8b06e3c727c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:56.362568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1a03-48ca-4813-9efb-b8b06e3c727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:56.439666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-748c1a03-48ca-4813-9efb-b8b06e3c727c None None] MFA Rules not processed for user `430b8a27f45148c2a98985e1f1d37c14`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:56.443679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-748c1a03-48ca-4813-9efb-b8b06e3c727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:56.467985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:56.469709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:56.470313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:56.473395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:56.477186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:56.527755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:56.529577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:56.549509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 850/1719] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:56.608948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 870/1720] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:56.628062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:56.629902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:56.684298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:56.811409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afad49-3078-4406-bd79-4fa94eacfb6d service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:56.985128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2dc72-c174-44ed-a3f8-8872cd6ad1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:56.985765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2dc72-c174-44ed-a3f8-8872cd6ad1e3 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:56.986055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2dc72-c174-44ed-a3f8-8872cd6ad1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:56.986334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2dc72-c174-44ed-a3f8-8872cd6ad1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:57.023176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2dc72-c174-44ed-a3f8-8872cd6ad1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:57.025441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2dc72-c174-44ed-a3f8-8872cd6ad1e3 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:57.052970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 851/1721] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:58.263683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9831a6-000b-4d6f-81df-f12e53099ef8 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:58.264235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9831a6-000b-4d6f-81df-f12e53099ef8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:58.264754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9831a6-000b-4d6f-81df-f12e53099ef8 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:58.266385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 871/1722] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:55:58.335369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed942c9-1d4c-4b77-a3e3-41853edcf7a2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:58.336201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed942c9-1d4c-4b77-a3e3-41853edcf7a2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:58.336656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed942c9-1d4c-4b77-a3e3-41853edcf7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:58.394199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-8ed942c9-1d4c-4b77-a3e3-41853edcf7a2 None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:55:58.399641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-8ed942c9-1d4c-4b77-a3e3-41853edcf7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:55:58.417385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 852/1723] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:55:58.747802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9831a6-000b-4d6f-81df-f12e53099ef8 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:58.780544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9831a6-000b-4d6f-81df-f12e53099ef8 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:58.792865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e64bfd-da54-4ccf-b5bf-e5080c2a2a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:58.794999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e64bfd-da54-4ccf-b5bf-e5080c2a2a90 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:58.795488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e64bfd-da54-4ccf-b5bf-e5080c2a2a90 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:58.795929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e64bfd-da54-4ccf-b5bf-e5080c2a2a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:58.818532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e64bfd-da54-4ccf-b5bf-e5080c2a2a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:58.830027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e64bfd-da54-4ccf-b5bf-e5080c2a2a90 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:58.917808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 872/1724] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:55:59.379829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed942c9-1d4c-4b77-a3e3-41853edcf7a2 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:55:59.559563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed942c9-1d4c-4b77-a3e3-41853edcf7a2 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:55:59.579592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:55:59.582253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:59.582888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:59.583636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] PATH_INFO: `/v3/users/430b8a27f45148c2a98985e1f1d37c14` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:55:59.586388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=430b8a27f45148c2a98985e1f1d37c14)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:55:59.589729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:55:59.757212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:55:59.807418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430b8a27f45148c2a98985e1f1d37c14'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:59.812805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430b8a27f45148c2a98985e1f1d37c14'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:59.905665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430b8a27f45148c2a98985e1f1d37c14'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:59.927341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430b8a27f45148c2a98985e1f1d37c14'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:59.929038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430b8a27f45148c2a98985e1f1d37c14'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:55:59.982456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 853/1725] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:55:59 2022] DELETE /identity/v3/users/430b8a27f45148c2a98985e1f1d37c14 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:55:59.986699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:55:59.988354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:55:59.988811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:00.017706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:00.019178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:00.184474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:00.371513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 873/1726] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:00.407815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:00.409451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:00.603059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a7af-76b6-4084-854d-e7fd5caca51d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:00.613080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:00.613506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:00.613801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:00.616760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:00.642001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:00.646451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:00.669386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 854/1727] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:00.986653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:00.988212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:01.015468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150745a-1813-48f5-9df9-f7db6c0ed1e9 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:01.025066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:01.026592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.026982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.027548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] PATH_INFO: `/v3/projects/9d02e1661a10457c9f4a52545866019f` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.030646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d02e1661a10457c9f4a52545866019f)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:01.034943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:01.054944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:01.057232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:01.095019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec720e-abdc-49dd-a4b5-30684867dfed service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:01.116408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:01.117427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.117727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.117990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] PATH_INFO: `/v3/projects/caa15bf50ba64a59b14643c504d61fb1` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.121210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa15bf50ba64a59b14643c504d61fb1)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:01.127953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:01.160728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d02e1661a10457c9f4a52545866019f', 'request_id': 'req-3e1110eb-27dc-4ffa-83b6-1656378c4224'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.168548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d02e1661a10457c9f4a52545866019f', 'request_id': 'req-3e1110eb-27dc-4ffa-83b6-1656378c4224'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.182543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d02e1661a10457c9f4a52545866019f', 'request_id': 'req-3e1110eb-27dc-4ffa-83b6-1656378c4224'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.230803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] The token cache is being invalidate because project 9d02e1661a10457c9f4a52545866019f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:01.231127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.232618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3e1110eb-27dc-4ffa-83b6-1656378c4224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.238471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 874/1728] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:00 2022] DELETE /identity/v3/projects/9d02e1661a10457c9f4a52545866019f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:01.243401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d67f-b187-4c83-8617-4ca3aabf6731 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.243688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d67f-b187-4c83-8617-4ca3aabf6731 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.243974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d67f-b187-4c83-8617-4ca3aabf6731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.268762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa15bf50ba64a59b14643c504d61fb1', 'request_id': 'req-75e3e4c1-4c30-4c06-b985-768a2a02c919'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.285177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa15bf50ba64a59b14643c504d61fb1', 'request_id': 'req-75e3e4c1-4c30-4c06-b985-768a2a02c919'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.287237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-da49d67f-b187-4c83-8617-4ca3aabf6731 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:01.291019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-da49d67f-b187-4c83-8617-4ca3aabf6731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:01.301569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa15bf50ba64a59b14643c504d61fb1', 'request_id': 'req-75e3e4c1-4c30-4c06-b985-768a2a02c919'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.332677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] The token cache is being invalidate because project caa15bf50ba64a59b14643c504d61fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:01.332999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.336341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-75e3e4c1-4c30-4c06-b985-768a2a02c919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:01.342192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 855/1729] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:01 2022] DELETE /identity/v3/projects/caa15bf50ba64a59b14643c504d61fb1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:01.344295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414dcca-01bf-44a9-96f1-8dd301c9d365 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.344529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414dcca-01bf-44a9-96f1-8dd301c9d365 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.346591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414dcca-01bf-44a9-96f1-8dd301c9d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.376024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5414dcca-01bf-44a9-96f1-8dd301c9d365 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:01.378048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5414dcca-01bf-44a9-96f1-8dd301c9d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:01.420501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:01.475886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 856/1730] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:01.485760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe3f3-dcc5-4c17-a2dc-699d17b12f6f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.488724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe3f3-dcc5-4c17-a2dc-699d17b12f6f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.490122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe3f3-dcc5-4c17-a2dc-699d17b12f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.496903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 875/1731] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:01.506335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2dcb-116e-42bd-963a-c6b9075e58e2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.512743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2dcb-116e-42bd-963a-c6b9075e58e2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.521217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2dcb-116e-42bd-963a-c6b9075e58e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.606105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-850fe3f3-dcc5-4c17-a2dc-699d17b12f6f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:01.607295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-199a2dcb-116e-42bd-963a-c6b9075e58e2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:01.608566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-199a2dcb-116e-42bd-963a-c6b9075e58e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:01.615404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-850fe3f3-dcc5-4c17-a2dc-699d17b12f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:01.641690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 876/1732] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:01.643635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a2dcb-116e-42bd-963a-c6b9075e58e2 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:01.647626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 857/1733] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:01.650966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe3f3-dcc5-4c17-a2dc-699d17b12f6f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:01.669455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a2dcb-116e-42bd-963a-c6b9075e58e2 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:01.680343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:01.681022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.681276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.681555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.685397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:01.685717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:01.688704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:01.692822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe3f3-dcc5-4c17-a2dc-699d17b12f6f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:01.722065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:01.723143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.726680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.726680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.728817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:01.729169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:01.729844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 877/1734] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:01.731903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:01.736451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:01.752162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f481f1d-9661-424c-ba8e-d050f0be15d4 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:01.768884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:01.769567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.769853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.770133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.770837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:01.774182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:01.786941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 858/1735] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:01.798165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:01.841647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e96b8-ebab-4b36-8081-64f66d9d98f3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:01.869377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:01.869950 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:01.870239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:01.870558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:01.876539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:01.890501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:01.899021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 878/1736] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:01 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:01.902015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:01.966962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:02.020905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 859/1737] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:01 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:02.022150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:02.141573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23ca78-f56b-4b50-90be-98d93534cbec admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.173597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110be634-9205-46af-a2c5-a2ab0cad4569 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.184634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.185483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.185867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.186991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.187796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.190304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.240798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 860/1738] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:02 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:02.245385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:02.259177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.261611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.261948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.263934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.264900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.267398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314668-42a9-49fc-b34f-70d58702ab61 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.270481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.286266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.287320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.287693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.288118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.289022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.293634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.302446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 879/1739] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:01 2022] POST /identity/v3/users => generated 290 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:02.303550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:02.319827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e6681-9099-4bff-9e14-a0b0d8a03068 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.327009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 861/1740] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:02.331099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:02.336709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.337852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.338786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.339512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.341665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.344688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.359330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d08b3-9209-4595-b288-18fb6ba563da admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.359997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 880/1741] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:02.361591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:02.372018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.374281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186c029-06bd-4984-a2f6-3b34fa0aae31 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.374423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.374587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.374875 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.377359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.379154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.380331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.380846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.382238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.382853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.383693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.386029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.404978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 881/1742] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:02.406591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:02.415658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 862/1743] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:02.416933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:02.423199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106a02-30b9-47f7-a7a4-b17741dafbf9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.431271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3b50c-07e8-4fe8-aa46-8c09535cfba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.433287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b50c-07e8-4fe8-aa46-8c09535cfba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.434103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b50c-07e8-4fe8-aa46-8c09535cfba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.434756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b50c-07e8-4fe8-aa46-8c09535cfba6 admin admin] PATH_INFO: `/v3/projects/111f1739455a4db3b9cceba6b9c36551/users/96b0aa11138b4b9cb5de0251aee643b3/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.446226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca264a-2899-4c0a-97aa-e2803de1a917 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:02.462827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3b50c-07e8-4fe8-aa46-8c09535cfba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111f1739455a4db3b9cceba6b9c36551, user_id=96b0aa11138b4b9cb5de0251aee643b3, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.466548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3b50c-07e8-4fe8-aa46-8c09535cfba6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.468754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190fcd1-469f-46fc-a05e-dabd4542d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:02.472912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190fcd1-469f-46fc-a05e-dabd4542d630 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.475213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190fcd1-469f-46fc-a05e-dabd4542d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.476726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190fcd1-469f-46fc-a05e-dabd4542d630 admin admin] PATH_INFO: `/v3/projects/1a63ff16e5f44dd0a5e3683e1b7cce51/users/ebd49944cee54f8399f3d04f9f1a3c87/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.524493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 882/1744] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:02 2022] PUT /identity/v3/projects/111f1739455a4db3b9cceba6b9c36551/users/96b0aa11138b4b9cb5de0251aee643b3/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:02.528246 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade642-6152-46ad-931c-a51a7c0bb4e9 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.528545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade642-6152-46ad-931c-a51a7c0bb4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.530812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ade642-6152-46ad-931c-a51a7c0bb4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.533097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190fcd1-469f-46fc-a05e-dabd4542d630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a63ff16e5f44dd0a5e3683e1b7cce51, user_id=ebd49944cee54f8399f3d04f9f1a3c87, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:02.542780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190fcd1-469f-46fc-a05e-dabd4542d630 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:02.585955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 863/1745] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:02 2022] PUT /identity/v3/projects/1a63ff16e5f44dd0a5e3683e1b7cce51/users/ebd49944cee54f8399f3d04f9f1a3c87/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:02.594230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70f61-f7ed-4d67-9ada-ea002db1d869 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:02.594664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70f61-f7ed-4d67-9ada-ea002db1d869 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:02.597323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70f61-f7ed-4d67-9ada-ea002db1d869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:02.627110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-06ade642-6152-46ad-931c-a51a7c0bb4e9 None None] MFA Rules not processed for user `96b0aa11138b4b9cb5de0251aee643b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:02.653762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-06ade642-6152-46ad-931c-a51a7c0bb4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:02.683240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b3b70f61-f7ed-4d67-9ada-ea002db1d869 None None] MFA Rules not processed for user `ebd49944cee54f8399f3d04f9f1a3c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:02.685468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b3b70f61-f7ed-4d67-9ada-ea002db1d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:02.790071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:02.841414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:02.874345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 883/1746] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:02.877009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade642-6152-46ad-931c-a51a7c0bb4e9 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.008775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 864/1747] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:03.009873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b70f61-f7ed-4d67-9ada-ea002db1d869 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.088999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ade642-6152-46ad-931c-a51a7c0bb4e9 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.096306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.097343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.097640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.097926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.099418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.105383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.181895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b70f61-f7ed-4d67-9ada-ea002db1d869 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.184411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 884/1748] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:02 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:03.189467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.365707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.367608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.368962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.369355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.370150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.376874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.422574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c36d4b-a12e-433e-b065-94dc49c09301 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.462318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 865/1749] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:03 2022] POST /identity/v3/projects => generated 363 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:03.463504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.464413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.464894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.465430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.466330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.466988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.469508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.530036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 885/1750] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:03 2022] POST /identity/v3/users => generated 289 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:03.533798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.561400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb347b9-fe7b-449f-b4ce-5895c09f1589 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.706266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f1a85-13f5-480c-8d3b-d33a430ab6e6 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.718732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.719549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.719905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.720304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.721291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.724127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.735803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:03.765563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.766270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.766560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.766842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.767586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.769820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.784795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 866/1751] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:03 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:03.786213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.794933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:03.810577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 886/1752] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:03.811460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.830687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:03.837092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a2bca-014f-4a59-bac3-3e5ad151bfa9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.838790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77efc2-4310-41e5-9038-c02fbdd6fcad admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.850836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.851759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.852054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.852294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] PATH_INFO: `/v3/projects/2650835410cd4b8fb7c14b0c6f075729` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.859376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2650835410cd4b8fb7c14b0c6f075729)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.862747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.886242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.887567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.888200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.888893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.890122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.893056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.915937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 887/1753] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:03.917863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.933051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae35bf-cc1c-408f-bfc4-2d84c9a744b4 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:03.942243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:03.943259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:03.944425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:03.945684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:03.947688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:03.950128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:03.968746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 888/1754] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:03.969882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:03.993054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06a0df-dfdd-48c5-883f-d0b16b9b2037 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:04.022325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2650835410cd4b8fb7c14b0c6f075729', 'request_id': 'req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:04.051903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2650835410cd4b8fb7c14b0c6f075729', 'request_id': 'req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:04.061615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2650835410cd4b8fb7c14b0c6f075729', 'request_id': 'req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:04.111309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] The token cache is being invalidate because project 2650835410cd4b8fb7c14b0c6f075729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:04.111852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:04.112771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:04.119043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 867/1755] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:03 2022] DELETE /identity/v3/projects/2650835410cd4b8fb7c14b0c6f075729 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:04.120819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:04.123284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:04.124897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9dbc3-746e-4936-ba28-e967361851c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:04.127635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9dbc3-746e-4936-ba28-e967361851c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.127929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9dbc3-746e-4936-ba28-e967361851c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.128209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9dbc3-746e-4936-ba28-e967361851c7 admin admin] PATH_INFO: `/v3/projects/d766f675ffdc4d44b25a73c541e9ddc5/users/771205fdea3747fea8daea5f08efd633/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.154583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b6e0-b5fb-41fe-9913-d8b175b8ebee admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:04.159284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9dbc3-746e-4936-ba28-e967361851c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d766f675ffdc4d44b25a73c541e9ddc5, user_id=771205fdea3747fea8daea5f08efd633, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:04.163129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9dbc3-746e-4936-ba28-e967361851c7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:04.172053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:04.179576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.180116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.180406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] PATH_INFO: `/v3/projects/8a49601a5ef74ebc90612bce010d37c5/users/0d3491478e974d67864a0be7635cbf54/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.198274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 889/1756] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:03 2022] PUT /identity/v3/projects/d766f675ffdc4d44b25a73c541e9ddc5/users/771205fdea3747fea8daea5f08efd633/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:04.200571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a5d34-0b4a-4829-a5c0-32c3e3f0d3cc None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.203327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a5d34-0b4a-4829-a5c0-32c3e3f0d3cc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.204713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a5d34-0b4a-4829-a5c0-32c3e3f0d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.219490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a49601a5ef74ebc90612bce010d37c5, user_id=0d3491478e974d67864a0be7635cbf54, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:04.223492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:04.258072 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-bd5a5d34-0b4a-4829-a5c0-32c3e3f0d3cc None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:04.260179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bd5a5d34-0b4a-4829-a5c0-32c3e3f0d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:04.280314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 868/1757] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:04 2022] PUT /identity/v3/projects/8a49601a5ef74ebc90612bce010d37c5/users/0d3491478e974d67864a0be7635cbf54/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:04.280314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:04.299149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:04.430900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 890/1758] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:04.430900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a6fb-2239-4a78-b7c9-1735d83cee1d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.430900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a6fb-2239-4a78-b7c9-1735d83cee1d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.430900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a6fb-2239-4a78-b7c9-1735d83cee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.440041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2aa6-0cb7-4143-b44c-4e2766b089ca admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:04.458232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558660b9-a297-4d4e-b92a-0422d5d7c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:04.462756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558660b9-a297-4d4e-b92a-0422d5d7c866 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.463474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558660b9-a297-4d4e-b92a-0422d5d7c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.463790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558660b9-a297-4d4e-b92a-0422d5d7c866 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.464339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558660b9-a297-4d4e-b92a-0422d5d7c866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:04.472729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558660b9-a297-4d4e-b92a-0422d5d7c866 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:04.512168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0637a6fb-2239-4a78-b7c9-1735d83cee1d None None] MFA Rules not processed for user `0d3491478e974d67864a0be7635cbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:04.515505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0637a6fb-2239-4a78-b7c9-1735d83cee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:04.523679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 869/1759] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:04.525913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491989d-fc7b-4458-a423-854bf450ce73 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.541688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491989d-fc7b-4458-a423-854bf450ce73 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.542060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491989d-fc7b-4458-a423-854bf450ce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.593611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-7491989d-fc7b-4458-a423-854bf450ce73 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:04.595193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7491989d-fc7b-4458-a423-854bf450ce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:04.628498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 870/1760] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:04.628498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491989d-fc7b-4458-a423-854bf450ce73 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:04.664088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491989d-fc7b-4458-a423-854bf450ce73 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:04.668469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:04.685623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450601-7bd0-40a6-b31e-b367bba3b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:04.687447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450601-7bd0-40a6-b31e-b367bba3b622 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.690330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 891/1761] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:04.690815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450601-7bd0-40a6-b31e-b367bba3b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.691224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a6fb-2239-4a78-b7c9-1735d83cee1d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:04.693391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450601-7bd0-40a6-b31e-b367bba3b622 admin admin] PATH_INFO: `/v3/projects/d766f675ffdc4d44b25a73c541e9ddc5/users/771205fdea3747fea8daea5f08efd633/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.701550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450601-7bd0-40a6-b31e-b367bba3b622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d766f675ffdc4d44b25a73c541e9ddc5, user_id=771205fdea3747fea8daea5f08efd633, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:04.710138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a6fb-2239-4a78-b7c9-1735d83cee1d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:04.715198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450601-7bd0-40a6-b31e-b367bba3b622 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:04.727880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99ef37-3262-4ace-81ac-5b6417433997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:04.728572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ef37-3262-4ace-81ac-5b6417433997 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.728993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ef37-3262-4ace-81ac-5b6417433997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.729402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ef37-3262-4ace-81ac-5b6417433997 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.732383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ef37-3262-4ace-81ac-5b6417433997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:04.732762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ef37-3262-4ace-81ac-5b6417433997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:04.737440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ef37-3262-4ace-81ac-5b6417433997 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:04.742916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 871/1762] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:04 2022] PUT /identity/v3/projects/d766f675ffdc4d44b25a73c541e9ddc5/users/771205fdea3747fea8daea5f08efd633/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:04.744929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e9715-5c40-4d46-a206-1a6d5f34b6f9 None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.744929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e9715-5c40-4d46-a206-1a6d5f34b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.745121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e9715-5c40-4d46-a206-1a6d5f34b6f9 None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.746453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 872/1763] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:56:04.747504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e9715-5c40-4d46-a206-1a6d5f34b6f9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:04.791402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 892/1764] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:04.791402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ac5f-2ae1-4da3-bddb-130b977b328d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.791402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ac5f-2ae1-4da3-bddb-130b977b328d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.793181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ac5f-2ae1-4da3-bddb-130b977b328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.820705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:04.862294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f971ac5f-2ae1-4da3-bddb-130b977b328d None None] MFA Rules not processed for user `771205fdea3747fea8daea5f08efd633`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:04.863875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f971ac5f-2ae1-4da3-bddb-130b977b328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:04.899942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e9715-5c40-4d46-a206-1a6d5f34b6f9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:04.908981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:04.909937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.911074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.911909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.913348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:04.915723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:04.956721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 873/1765] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:04 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:04.961051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:04.963852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 893/1766] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:04.968011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694fad-a3b3-4cee-b5ae-fc445889daca None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:04.968011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694fad-a3b3-4cee-b5ae-fc445889daca None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:04.968011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694fad-a3b3-4cee-b5ae-fc445889daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:04.990089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7b694fad-a3b3-4cee-b5ae-fc445889daca None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:04.991434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7b694fad-a3b3-4cee-b5ae-fc445889daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:05.052162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be46a3-93dd-448f-a4d9-cb70e7751ead admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.058318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.058995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.059284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.059564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.060255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.062231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.085741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 894/1767] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:05.086481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694fad-a3b3-4cee-b5ae-fc445889daca None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.093744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 874/1768] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:04 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:05.093744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.095520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:05.101360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694fad-a3b3-4cee-b5ae-fc445889daca None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.169636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872ad0-3fc0-47d7-9e7b-a4eba3a87765 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.173966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.175405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.175800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.176188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.196112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.196856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.197147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.197428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.199204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.201209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.211340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:05.238512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 895/1769] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:05 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:05.239670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.255445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc11f-62f5-4813-b9ce-ae488ac607db admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.265699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.266399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.266687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.266986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.267673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.269648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.271809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:05.291754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.293363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.306794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 875/1770] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:05.308171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.309701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:05.355195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 896/1771] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:05 2022] POST /identity/v3/users => generated 302 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:05.356598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.369228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a7a2-29f4-4767-b004-f09dbec1206a admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.374887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.375577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.375867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.376150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.377205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.379018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.398290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 897/1772] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:05.399224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.412030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113af2-4344-4f24-8ecc-8f693ab9da2b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.426485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.427175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.427282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad11ae5-4d10-4f05-976b-35f04255e39a service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.427644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.427927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.432830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.433790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.434539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.434699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.434854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.435255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.445862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.447649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.460306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 898/1773] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:05.461436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.480197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae7727-a456-4221-a9f5-656f00d28f08 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.482818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 876/1774] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:05.483848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.497254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.499096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.499866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.499866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] PATH_INFO: `/v3/projects/85733c182eb943bcba804a8bfd80e664/users/682dc296d0094ca794e9d93b4a9e4530/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.505031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f115bc-12cd-4019-a832-98043d03ae32 service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.511355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.512046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.512332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.512689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.513415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.514971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.526079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85733c182eb943bcba804a8bfd80e664, user_id=682dc296d0094ca794e9d93b4a9e4530, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.526559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 877/1775] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:05.529544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.530895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.545928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90bbc7-af3e-4bf0-a243-7dbef9ec9a7a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.553551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 899/1776] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:05 2022] PUT /identity/v3/projects/85733c182eb943bcba804a8bfd80e664/users/682dc296d0094ca794e9d93b4a9e4530/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:05.558554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.666153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e4dab-c98b-4cc4-ac36-896610a4fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.668177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4dab-c98b-4cc4-ac36-896610a4fa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.669137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4dab-c98b-4cc4-ac36-896610a4fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.669670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4dab-c98b-4cc4-ac36-896610a4fa30 admin admin] PATH_INFO: `/v3/projects/c0b784f371fd4c34ac122ebb652350f6/users/b9d768a9eb1b49ba8b940936a0a6eee5/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.689693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b48b1-61f8-4815-bc75-0c43bb51cb5c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.691824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e4dab-c98b-4cc4-ac36-896610a4fa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b784f371fd4c34ac122ebb652350f6, user_id=b9d768a9eb1b49ba8b940936a0a6eee5, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.695938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e4dab-c98b-4cc4-ac36-896610a4fa30 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.717447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.718140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.718428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.718709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.719101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 878/1777] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:05 2022] PUT /identity/v3/projects/c0b784f371fd4c34ac122ebb652350f6/users/b9d768a9eb1b49ba8b940936a0a6eee5/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:05.719759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.721411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.721533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.721832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.722118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.733807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 900/1778] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:05.738660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.756050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74badd5-b946-4c42-8ac0-fda439449d40 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.760464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:05.764048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:05.859559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:05.862686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:05.863859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:05.864267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:05.864759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] PATH_INFO: `/v3/projects/85733c182eb943bcba804a8bfd80e664/users/682dc296d0094ca794e9d93b4a9e4530/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:05.868260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=85733c182eb943bcba804a8bfd80e664, user_id=682dc296d0094ca794e9d93b4a9e4530, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:05.881872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:05.896743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 879/1779] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:05.896743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.897488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 901/1780] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:05 2022] PUT /identity/v3/projects/85733c182eb943bcba804a8bfd80e664/users/682dc296d0094ca794e9d93b4a9e4530/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:05.905533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:05.905976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:05.908493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:05.921103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a39ed-d989-42f0-ada6-2e70bfaf4c5c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:05.947197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:06.028368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20376c00-288b-46de-83e5-25a71b097daa admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:06.040093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6949b7-4c99-4b47-8fce-7485cd8b155e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:06.041131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6949b7-4c99-4b47-8fce-7485cd8b155e service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.041470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6949b7-4c99-4b47-8fce-7485cd8b155e service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.041814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6949b7-4c99-4b47-8fce-7485cd8b155e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.044463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:06.045682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.046036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.046434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] PATH_INFO: `/v3/users/c7b2a2a1215841f597c4d0defbb65f4d` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.048179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b2a2a1215841f597c4d0defbb65f4d)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:06.050931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:06.055472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6949b7-4c99-4b47-8fce-7485cd8b155e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:06.057535 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6949b7-4c99-4b47-8fce-7485cd8b155e service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:06.071147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 902/1781] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:06.072715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6983-3ddf-459e-8e5d-37d087a6b115 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.073077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6983-3ddf-459e-8e5d-37d087a6b115 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.073428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6983-3ddf-459e-8e5d-37d087a6b115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.137165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b2a2a1215841f597c4d0defbb65f4d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.137838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b2a2a1215841f597c4d0defbb65f4d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.141622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-93eb6983-3ddf-459e-8e5d-37d087a6b115 None None] MFA Rules not processed for user `682dc296d0094ca794e9d93b4a9e4530`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:06.142871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-93eb6983-3ddf-459e-8e5d-37d087a6b115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.167943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b2a2a1215841f597c4d0defbb65f4d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.181088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b2a2a1215841f597c4d0defbb65f4d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.185379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b2a2a1215841f597c4d0defbb65f4d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.212415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 880/1782] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:05 2022] DELETE /identity/v3/users/c7b2a2a1215841f597c4d0defbb65f4d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:06.213717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:06.215831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.321256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 903/1783] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:06.323659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.324402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.324962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.370659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb046f-57cf-482b-a33a-176c9a639c18 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:06.376417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:06.377747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.380164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:06.382194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.383086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.383619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] PATH_INFO: `/v3/users/ebd49944cee54f8399f3d04f9f1a3c87` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.385697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd49944cee54f8399f3d04f9f1a3c87)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:06.389542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:06.396665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 904/1784] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:06.399748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:06.401817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:06.404123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.484030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd49944cee54f8399f3d04f9f1a3c87'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.485321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd49944cee54f8399f3d04f9f1a3c87'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.513009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd49944cee54f8399f3d04f9f1a3c87'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.514977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c93612-b492-4424-8c00-13f703c6d12c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:06.523782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd49944cee54f8399f3d04f9f1a3c87'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.524532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd49944cee54f8399f3d04f9f1a3c87'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:06.545001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d3ef5-bb5d-41d1-bb2b-30eeb5add852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:06.545828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d3ef5-bb5d-41d1-bb2b-30eeb5add852 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.547997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d3ef5-bb5d-41d1-bb2b-30eeb5add852 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.549533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d3ef5-bb5d-41d1-bb2b-30eeb5add852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.554952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1c1d3ef5-bb5d-41d1-bb2b-30eeb5add852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.557755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 881/1785] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:06 2022] DELETE /identity/v3/users/ebd49944cee54f8399f3d04f9f1a3c87 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:06.559681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:06.561308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.632687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:06.664929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d3ef5-bb5d-41d1-bb2b-30eeb5add852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:06.667743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d3ef5-bb5d-41d1-bb2b-30eeb5add852 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:06.670453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0122a05-d05a-45cc-bf0d-476e86f4f294 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:06.675733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:06.676683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.677463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.677463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.680097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.682884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 905/1786] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:06.684742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e777a-836b-4ab5-be66-396afa2a7d26 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.685136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e777a-836b-4ab5-be66-396afa2a7d26 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.685612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e777a-836b-4ab5-be66-396afa2a7d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.714872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-996e777a-836b-4ab5-be66-396afa2a7d26 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:06.716397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-996e777a-836b-4ab5-be66-396afa2a7d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.803989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:06.809083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:06.824024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 882/1787] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:06.828179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:06.832360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 906/1788] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:06.837781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:06.853791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e777a-836b-4ab5-be66-396afa2a7d26 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:06.868891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e777a-836b-4ab5-be66-396afa2a7d26 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:06.892795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e473ab-546b-4def-900b-af69419ff0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:06.893608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e473ab-546b-4def-900b-af69419ff0cf service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.894187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e473ab-546b-4def-900b-af69419ff0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.894475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e473ab-546b-4def-900b-af69419ff0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.910162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e473ab-546b-4def-900b-af69419ff0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:06.911696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e473ab-546b-4def-900b-af69419ff0cf service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:06.924722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 907/1789] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:06.929494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:06.968692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8129b65-d994-450d-adb5-126f3dd4e60c service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:06.976079 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:06.976781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:06.977184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:06.977465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:06.981715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:07.064994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:07.066454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:07.075940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 883/1790] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:07.261886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:07.262582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:07.263106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:07.301317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] MFA Rules not processed for user `b9d768a9eb1b49ba8b940936a0a6eee5`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:07.302947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:07.415571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:07.417202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:07.435248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc47c3-19b2-4b65-b407-62d65cc02088 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:07.442206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:07.443337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:07.443962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:07.444457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] PATH_INFO: `/v3/projects/676e0b467ffe492a9388b31c5ce70da0` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:07.446159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=676e0b467ffe492a9388b31c5ce70da0)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:07.449236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:07.458355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 908/1791] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:07.463141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:07.466995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:07.502233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3fba4-0046-490c-9686-a933fe7cf19f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:07.517413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:07.518367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:07.521695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:07.522698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:07.524065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:07.527285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:07.544569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676e0b467ffe492a9388b31c5ce70da0', 'request_id': 'req-f6a2b0c9-b155-4347-be41-41bce69e6b47'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.559626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676e0b467ffe492a9388b31c5ce70da0', 'request_id': 'req-f6a2b0c9-b155-4347-be41-41bce69e6b47'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.563053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 909/1792] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:07 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:07.567532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:07.570020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676e0b467ffe492a9388b31c5ce70da0', 'request_id': 'req-f6a2b0c9-b155-4347-be41-41bce69e6b47'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.588493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] The token cache is being invalidate because project 676e0b467ffe492a9388b31c5ce70da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:07.588916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.589678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.595017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 884/1793] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:07 2022] DELETE /identity/v3/projects/676e0b467ffe492a9388b31c5ce70da0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:07.596775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:07.614246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:07.680122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:07.761217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1289a-926b-4e02-8990-2f03b9a0554b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:07.778839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2b0c9-b155-4347-be41-41bce69e6b47 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:07.778839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:07.778839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:07.778839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:07.779320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] PATH_INFO: `/v3/users/5c9164228616458da3d2c1ea88e388ec` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:07.779320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9164228616458da3d2c1ea88e388ec)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:07.780860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:07.791773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:07.793373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:07.794032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:07.794537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:07.795461 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:07.797717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:07.800353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:07.825825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 910/1794] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:07 2022] POST /identity/v3/users => generated 308 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:07.829692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:07.831741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:07.845089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ec17e-5783-4b8d-becf-cf82fe2c7d01 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:07.850255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:07.850881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:07.851614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:07.851725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9164228616458da3d2c1ea88e388ec'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.851805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:07.852174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:07.852638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9164228616458da3d2c1ea88e388ec'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.853831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:07.867012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 911/1795] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:07.871422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:07.873146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:07.882028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9164228616458da3d2c1ea88e388ec'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.887593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9491af-d7e5-499d-8f22-f21d099966f8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:07.889954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9164228616458da3d2c1ea88e388ec'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.890698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9164228616458da3d2c1ea88e388ec'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:07.893050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:07.894137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:07.894583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:07.895057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] PATH_INFO: `/v3/projects/94586198fc8049b884ac50038661210a/users/2fb01550e76443b8af77bc4173de3e6e/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:07.910355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 885/1796] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:07 2022] DELETE /identity/v3/users/5c9164228616458da3d2c1ea88e388ec => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:07.925947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94586198fc8049b884ac50038661210a, user_id=2fb01550e76443b8af77bc4173de3e6e, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:07.929549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:07.948623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 912/1797] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:07 2022] PUT /identity/v3/projects/94586198fc8049b884ac50038661210a/users/2fb01550e76443b8af77bc4173de3e6e/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:07.951448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:08.028485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:08.032125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:08.032251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d8647-d779-4c17-9154-2baa80208c2a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:08.126600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:08.128473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:08.129308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:08.129909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:08.131950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b9a6f-9641-4ba7-a38b-1b3fba4e3215 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:08.132672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:08.134352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:08.141775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:08.142891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:08.143664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:08.143664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] PATH_INFO: `/v3/projects/1a63ff16e5f44dd0a5e3683e1b7cce51` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:08.144855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a63ff16e5f44dd0a5e3683e1b7cce51)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:08.149813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 886/1798] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:08.149995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:08.150727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:08.163931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d746286-ec0a-4b99-96ba-d2e207e73388 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:08.169782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:08.170788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:08.172228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:08.172624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] PATH_INFO: `/v3/projects/94586198fc8049b884ac50038661210a/users/2fb01550e76443b8af77bc4173de3e6e/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:08.175238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=94586198fc8049b884ac50038661210a, user_id=2fb01550e76443b8af77bc4173de3e6e, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:08.179565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:08.196652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 887/1799] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:08 2022] PUT /identity/v3/projects/94586198fc8049b884ac50038661210a/users/2fb01550e76443b8af77bc4173de3e6e/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:08.213802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a63ff16e5f44dd0a5e3683e1b7cce51', 'request_id': 'req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.221566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a63ff16e5f44dd0a5e3683e1b7cce51', 'request_id': 'req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.233686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a63ff16e5f44dd0a5e3683e1b7cce51', 'request_id': 'req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.249097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] The token cache is being invalidate because project 1a63ff16e5f44dd0a5e3683e1b7cce51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:08.249395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.250737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.252821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 913/1800] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:08 2022] DELETE /identity/v3/projects/1a63ff16e5f44dd0a5e3683e1b7cce51 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:08.266254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:08.268707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:08.323585 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:08.392566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7016f-fa77-4d65-ad39-50e8c1f8a4fc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:08.403317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:08.405470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:08.406039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:08.407224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] PATH_INFO: `/v3/users/771205fdea3747fea8daea5f08efd633` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:08.409874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=771205fdea3747fea8daea5f08efd633)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:08.415343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:08.478545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771205fdea3747fea8daea5f08efd633'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.479259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771205fdea3747fea8daea5f08efd633'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.493595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771205fdea3747fea8daea5f08efd633'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.501412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771205fdea3747fea8daea5f08efd633'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.502196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771205fdea3747fea8daea5f08efd633'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:08.519198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 888/1801] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:08 2022] DELETE /identity/v3/users/771205fdea3747fea8daea5f08efd633 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:08.974637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:08.981917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:09.097884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:09.202684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab50ed-e3c4-46e7-8b54-33ca534e867b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.273851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.275397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:09.394657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf335e41-ff15-45f1-901e-93c4d82802ad admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.394840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.395892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.396375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.397334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] PATH_INFO: `/v3/projects/6f1b416e8fdf420bbfd2584f42443286` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.399386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1b416e8fdf420bbfd2584f42443286)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.401052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.402554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.402849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.403001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.403140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] PATH_INFO: `/v3/projects/d766f675ffdc4d44b25a73c541e9ddc5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.404550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d766f675ffdc4d44b25a73c541e9ddc5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.406561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.477449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:09.478764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1b416e8fdf420bbfd2584f42443286', 'request_id': 'req-15a945ba-066e-4ce3-88e6-14f6d64ba061'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.482911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd766f675ffdc4d44b25a73c541e9ddc5', 'request_id': 'req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.488108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1b416e8fdf420bbfd2584f42443286', 'request_id': 'req-15a945ba-066e-4ce3-88e6-14f6d64ba061'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.494528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd766f675ffdc4d44b25a73c541e9ddc5', 'request_id': 'req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.501160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1b416e8fdf420bbfd2584f42443286', 'request_id': 'req-15a945ba-066e-4ce3-88e6-14f6d64ba061'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.504406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd766f675ffdc4d44b25a73c541e9ddc5', 'request_id': 'req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.514151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] The token cache is being invalidate because project 6f1b416e8fdf420bbfd2584f42443286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:09.514471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.515137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-15a945ba-066e-4ce3-88e6-14f6d64ba061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.516967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 914/1802] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:08 2022] DELETE /identity/v3/projects/6f1b416e8fdf420bbfd2584f42443286 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:09.518443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] The token cache is being invalidate because project d766f675ffdc4d44b25a73c541e9ddc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:09.518928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.519751 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-33d2c86a-294e-4d11-8d70-f9d5a45b81a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:09.521530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 889/1803] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:09 2022] DELETE /identity/v3/projects/d766f675ffdc4d44b25a73c541e9ddc5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:09.522383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1371d8-4f3d-4386-8111-ce7e2c44d3c5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.522741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1371d8-4f3d-4386-8111-ce7e2c44d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.523133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1371d8-4f3d-4386-8111-ce7e2c44d3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.526845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad18b3-d4f4-42bc-92a9-ab41b2629ff0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.527136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad18b3-d4f4-42bc-92a9-ab41b2629ff0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.527418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad18b3-d4f4-42bc-92a9-ab41b2629ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.544491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0a1371d8-4f3d-4386-8111-ce7e2c44d3c5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:09.545972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0a1371d8-4f3d-4386-8111-ce7e2c44d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:09.548718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-22ad18b3-d4f4-42bc-92a9-ab41b2629ff0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:09.550161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-22ad18b3-d4f4-42bc-92a9-ab41b2629ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:09.621076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 890/1804] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:09.626083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 915/1805] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:09.627988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68953e0-f2cd-404a-aace-56de0ff7a5ca None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.628282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68953e0-f2cd-404a-aace-56de0ff7a5ca None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.628771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68953e0-f2cd-404a-aace-56de0ff7a5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.633998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96454511-7ce9-449e-aeaa-32b77699591e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.634385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96454511-7ce9-449e-aeaa-32b77699591e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.634843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96454511-7ce9-449e-aeaa-32b77699591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.652109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:09.654629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c68953e0-f2cd-404a-aace-56de0ff7a5ca None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:09.656123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c68953e0-f2cd-404a-aace-56de0ff7a5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:09.670482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 891/1806] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:09.676293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68953e0-f2cd-404a-aace-56de0ff7a5ca None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.685873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-96454511-7ce9-449e-aeaa-32b77699591e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:09.687581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-96454511-7ce9-449e-aeaa-32b77699591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:09.687693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68953e0-f2cd-404a-aace-56de0ff7a5ca None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.692566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.693312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.693633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.693912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.694654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:09.694964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.696878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 916/1807] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:09.697009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.700921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96454511-7ce9-449e-aeaa-32b77699591e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.710903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96454511-7ce9-449e-aeaa-32b77699591e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.714887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 892/1808] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:09.715631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.726975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.727902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.728088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa25b9-b424-441c-b469-4f78a8f6d140 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.728464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.730388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.730832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:09.731408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.733218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.742097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.743364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.743758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.744211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.745075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.748340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.754660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 917/1809] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:56:09.755972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.770346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23aa5e-b2a0-41e4-9172-0d614eddaae6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.776753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e232cf-42d8-4a0e-bd95-4b612c8383e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.777509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e232cf-42d8-4a0e-bd95-4b612c8383e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.777895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e232cf-42d8-4a0e-bd95-4b612c8383e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.778252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e232cf-42d8-4a0e-bd95-4b612c8383e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.778972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e232cf-42d8-4a0e-bd95-4b612c8383e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.781114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e232cf-42d8-4a0e-bd95-4b612c8383e5 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.788990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 893/1810] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:09.797689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.817913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 918/1811] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:09.820626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e060-7e37-4203-a050-d6db82acdce4 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.821128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e060-7e37-4203-a050-d6db82acdce4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.821241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e060-7e37-4203-a050-d6db82acdce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.850270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-2fe2e060-7e37-4203-a050-d6db82acdce4 None None] MFA Rules not processed for user `2fb01550e76443b8af77bc4173de3e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:09.851869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2fe2e060-7e37-4203-a050-d6db82acdce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:09.876247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81ec52-c1fe-470c-9941-68817a2cdb86 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.915441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:09.944686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 919/1812] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:09.945617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2e060-7e37-4203-a050-d6db82acdce4 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.950621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.951341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.951635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.951916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.952667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.954643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.958190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2e060-7e37-4203-a050-d6db82acdce4 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:09.967058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:09.967842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:09.968186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:09.968557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:09.969303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:09.971644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:09.981934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 894/1813] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:09.986475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:09.998638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e5be-93d8-4f33-9bc6-374270797471 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.005659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 920/1814] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:09 2022] POST /identity/v3/users => generated 282 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:10.006684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.007407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.008029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.008350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.008626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.009371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.011213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.020392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fcf77-75fc-4798-ae2e-556924bd920f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.027341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.028222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.028817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.029439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.029598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 895/1815] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.030596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.030903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.032721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.043633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f4c50-edff-4337-ba0e-32e31bce595a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.051586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.052854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.052854 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.053106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.053826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.055521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.064937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 921/1816] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.070189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.077382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 896/1817] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.078406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.090231 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413a660-9ab6-4f09-b1cc-63166900491c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.095708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba203b-535d-47d2-b9ee-0379dcc76b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.096783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba203b-535d-47d2-b9ee-0379dcc76b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.097171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba203b-535d-47d2-b9ee-0379dcc76b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.097672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba203b-535d-47d2-b9ee-0379dcc76b2d admin admin] PATH_INFO: `/v3/projects/4fb9163e959c4d1bb9c7ab0e391e9b98/users/06fd4e9660434da5b58b040ed3b22fb5/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.098771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226bfd-c489-4764-a0a7-0db3481b5257 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.111608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.112302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.112621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.113387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.114123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.117045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.117954 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba203b-535d-47d2-b9ee-0379dcc76b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb9163e959c4d1bb9c7ab0e391e9b98, user_id=06fd4e9660434da5b58b040ed3b22fb5, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.122180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba203b-535d-47d2-b9ee-0379dcc76b2d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.137459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 922/1818] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.142506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.148660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 897/1819] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:10 2022] PUT /identity/v3/projects/4fb9163e959c4d1bb9c7ab0e391e9b98/users/06fd4e9660434da5b58b040ed3b22fb5/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:10.153681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1fe40-88a4-4f20-ae7b-196c6354737a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.154050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1fe40-88a4-4f20-ae7b-196c6354737a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.154340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1fe40-88a4-4f20-ae7b-196c6354737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.157937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfbb21-fcee-448e-a763-84f389f80822 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.184310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-dcc1fe40-88a4-4f20-ae7b-196c6354737a None None] MFA Rules not processed for user `06fd4e9660434da5b58b040ed3b22fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:10.185650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dcc1fe40-88a4-4f20-ae7b-196c6354737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:10.272624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9be971-a7d3-47f4-8eb8-d0777183e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.273726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be971-a7d3-47f4-8eb8-d0777183e793 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.274015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be971-a7d3-47f4-8eb8-d0777183e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.274297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be971-a7d3-47f4-8eb8-d0777183e793 admin admin] PATH_INFO: `/v3/projects/776fe1748775411c9a9dc5740d6b19b8/users/1b8675b65fcd44f39fa6913a185c7e9d/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.288401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:10.292329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9be971-a7d3-47f4-8eb8-d0777183e793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776fe1748775411c9a9dc5740d6b19b8, user_id=1b8675b65fcd44f39fa6913a185c7e9d, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.295916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9be971-a7d3-47f4-8eb8-d0777183e793 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.296345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 898/1820] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:10.301165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1fe40-88a4-4f20-ae7b-196c6354737a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.317844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 923/1821] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:10 2022] PUT /identity/v3/projects/776fe1748775411c9a9dc5740d6b19b8/users/1b8675b65fcd44f39fa6913a185c7e9d/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:10.325730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1fe40-88a4-4f20-ae7b-196c6354737a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.329000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a85f-af31-49b0-8436-a6577a68d694 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.329300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a85f-af31-49b0-8436-a6577a68d694 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.329581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a85f-af31-49b0-8436-a6577a68d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.357366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ad14a85f-af31-49b0-8436-a6577a68d694 None None] MFA Rules not processed for user `1b8675b65fcd44f39fa6913a185c7e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:10.358600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ad14a85f-af31-49b0-8436-a6577a68d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:10.391530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.392199 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.392614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.392923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.393753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.395860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.411889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:10.427433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 924/1822] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:10.430123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 899/1823] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:10 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:10.431160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a85f-af31-49b0-8436-a6577a68d694 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.432856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.444716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a85f-af31-49b0-8436-a6577a68d694 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.496889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470056b0-2638-4810-ae3e-1b5de6e9b911 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.501661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.502325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.502620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.502906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.503611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.505697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.505825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.506514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.506853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.507095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.507776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.509707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.535713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 925/1824] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:10 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:10.535842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 900/1825] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:10 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:10.539122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.539281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.550932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdd23d-11b6-4570-a274-6ad959c51021 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.618974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6abfc7-a2fa-4289-81d4-c346a7a9321b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.622675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.623413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.623705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.623982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.624155 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.624746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.624859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.625133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.625413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.626134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.626371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.628064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.636492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 926/1826] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.643256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.650048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 901/1827] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:10 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:10.653887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb0447-897e-4798-8360-44d1998318ee admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.654011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.658568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.659555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.659743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.660092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] PATH_INFO: `/v3/projects/c1e515c43fb34343843b93dabc85c4a0/users/09b3819d481a456c8cd216895f31491f/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.663207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:10.665222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096489f-55a2-4897-b93e-df67227b7be7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.670272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.670944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.671278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.671598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.672329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.674040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.680765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e515c43fb34343843b93dabc85c4a0, user_id=09b3819d481a456c8cd216895f31491f, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.683960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.686639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 902/1828] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.691364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.700733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 927/1829] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:10 2022] PUT /identity/v3/projects/c1e515c43fb34343843b93dabc85c4a0/users/09b3819d481a456c8cd216895f31491f/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:10.703932 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd56-8c58-489a-8995-f77187632606 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.705067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.784252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3a7c-e695-40f7-a992-e0660b061280 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.789230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.790189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.790486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.790766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] PATH_INFO: `/v3/projects/fc253472be1545559d1dbe32d86586b0/users/cae2fb78d1ac48b28840d24443a15e87/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.791465 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.792407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.792892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.793326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.793521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:10.794242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.796314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.813607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 928/1830] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.815437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc253472be1545559d1dbe32d86586b0, user_id=cae2fb78d1ac48b28840d24443a15e87, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.817237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.819164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.836042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace0ae-66c1-4cbb-bf5b-72db39c05a22 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.842423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 903/1831] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:10 2022] PUT /identity/v3/projects/fc253472be1545559d1dbe32d86586b0/users/cae2fb78d1ac48b28840d24443a15e87/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:10.849737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.945675 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b13b2-c8c3-4cd6-9650-904db1ea0b45 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:10.951560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b272e-3341-489b-aeba-a1d47d36cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.952378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b272e-3341-489b-aeba-a1d47d36cf39 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.952809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b272e-3341-489b-aeba-a1d47d36cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.952923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:10.953852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b272e-3341-489b-aeba-a1d47d36cf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.953991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.954197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b272e-3341-489b-aeba-a1d47d36cf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.954301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.954488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] PATH_INFO: `/v3/projects/c1e515c43fb34343843b93dabc85c4a0/users/09b3819d481a456c8cd216895f31491f/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:10.956081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b272e-3341-489b-aeba-a1d47d36cf39 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.956799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e515c43fb34343843b93dabc85c4a0, user_id=09b3819d481a456c8cd216895f31491f, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:10.960800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:10.980616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 929/1832] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:10 2022] PUT /identity/v3/projects/c1e515c43fb34343843b93dabc85c4a0/users/09b3819d481a456c8cd216895f31491f/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:10.980804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 904/1833] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:10.981341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:10.991782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:10.992693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:10.993061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.050537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] MFA Rules not processed for user `09b3819d481a456c8cd216895f31491f`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:11.050537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:11.098579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca4e78-017d-4ed9-8fa6-e25c224e0db4 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:11.104975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90959afd-921a-4d36-bae3-c304bfb62766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:11.105893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90959afd-921a-4d36-bae3-c304bfb62766 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:11.106179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90959afd-921a-4d36-bae3-c304bfb62766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:11.106507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90959afd-921a-4d36-bae3-c304bfb62766 admin admin] PATH_INFO: `/v3/projects/fc253472be1545559d1dbe32d86586b0/users/cae2fb78d1ac48b28840d24443a15e87/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.108801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90959afd-921a-4d36-bae3-c304bfb62766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc253472be1545559d1dbe32d86586b0, user_id=cae2fb78d1ac48b28840d24443a15e87, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:11.120666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90959afd-921a-4d36-bae3-c304bfb62766 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:11.129854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 930/1834] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:10 2022] PUT /identity/v3/projects/fc253472be1545559d1dbe32d86586b0/users/cae2fb78d1ac48b28840d24443a15e87/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:11.139628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:11.139912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:11.140194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.154585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:11.156789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 905/1835] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:11.172502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:11.173895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] MFA Rules not processed for user `cae2fb78d1ac48b28840d24443a15e87`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:11.174818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:11.175494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:11.239819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850395-6bd2-49e3-b11c-620884eb8dec None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:11.260863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:11.267849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 931/1836] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:11.279589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:11.281274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:11.302795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:11.304621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:11.305244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:11.305573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.357226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d76b6-55a8-45da-8ac2-f5834e28f256 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:11.362355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:11.363449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:11.363610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:11.363885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.373567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:11.374749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:11.375180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:11.376423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:11.385642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 906/1837] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:11.386618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:11.387411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 932/1838] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:11.388288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:11.478222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0258c4-064e-46ca-909d-74894f6ba5b0 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:11.483951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:11.485094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:11.485520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:11.485968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] PATH_INFO: `/v3/users/b9d768a9eb1b49ba8b940936a0a6eee5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.487380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d768a9eb1b49ba8b940936a0a6eee5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:11.489469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:11.506902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:11.518461 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b7c8d-3a6b-4019-8474-dd1bc0d93a7d service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:11.523702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:11.525169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:11.525470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:11.526236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.561094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d768a9eb1b49ba8b940936a0a6eee5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.562310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d768a9eb1b49ba8b940936a0a6eee5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.580615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d768a9eb1b49ba8b940936a0a6eee5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.591057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d768a9eb1b49ba8b940936a0a6eee5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.592110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d768a9eb1b49ba8b940936a0a6eee5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.594923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:11.611569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 907/1839] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:11 2022] DELETE /identity/v3/users/b9d768a9eb1b49ba8b940936a0a6eee5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:11.613599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:11.615863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:11.628033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 933/1840] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:11.823606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:11.825685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:11.902159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481194c-022c-446a-a72d-0c3ec8373fe7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:11.906755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:11.907618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:11.907902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:11.908182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] PATH_INFO: `/v3/projects/c0b784f371fd4c34ac122ebb652350f6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:11.909439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b784f371fd4c34ac122ebb652350f6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:11.911326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:11.964106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b784f371fd4c34ac122ebb652350f6', 'request_id': 'req-392f407d-4264-4fa1-8d04-46bd166a999a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.974689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b784f371fd4c34ac122ebb652350f6', 'request_id': 'req-392f407d-4264-4fa1-8d04-46bd166a999a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.982393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b784f371fd4c34ac122ebb652350f6', 'request_id': 'req-392f407d-4264-4fa1-8d04-46bd166a999a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.994208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] The token cache is being invalidate because project c0b784f371fd4c34ac122ebb652350f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:11.994499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.995165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:11.996734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 908/1841] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:11 2022] DELETE /identity/v3/projects/c0b784f371fd4c34ac122ebb652350f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:12.000870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:12.011662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301d468-b6bd-46c7-8ed7-c6b6d6b0a954 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:12.044883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:12.073587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:12.074474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.074765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.075048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] PATH_INFO: `/v3/users/2fb01550e76443b8af77bc4173de3e6e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.076247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb01550e76443b8af77bc4173de3e6e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:12.078210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:12.139318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb01550e76443b8af77bc4173de3e6e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.151953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb01550e76443b8af77bc4173de3e6e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.173029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb01550e76443b8af77bc4173de3e6e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.173802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb01550e76443b8af77bc4173de3e6e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.174417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c68d0e45-5c6e-45fd-97f0-068b00a69107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb01550e76443b8af77bc4173de3e6e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.192865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 934/1842] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:11 2022] DELETE /identity/v3/users/2fb01550e76443b8af77bc4173de3e6e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:12.385022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:12.386522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:12.401598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f407d-4264-4fa1-8d04-46bd166a999a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:12.460340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:12.461529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.461914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.462328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] PATH_INFO: `/v3/projects/94586198fc8049b884ac50038661210a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.464317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94586198fc8049b884ac50038661210a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:12.467674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:12.512250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:12.532245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94586198fc8049b884ac50038661210a', 'request_id': 'req-815b9cd9-4764-4eae-af70-9c9b4cef0a91'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.541089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94586198fc8049b884ac50038661210a', 'request_id': 'req-815b9cd9-4764-4eae-af70-9c9b4cef0a91'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.546856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94586198fc8049b884ac50038661210a', 'request_id': 'req-815b9cd9-4764-4eae-af70-9c9b4cef0a91'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.558601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] The token cache is being invalidate because project 94586198fc8049b884ac50038661210a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:12.558901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.559737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-815b9cd9-4764-4eae-af70-9c9b4cef0a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:12.561330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 909/1843] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:12 2022] DELETE /identity/v3/projects/94586198fc8049b884ac50038661210a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:12.566309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89889d9-d15d-4805-b8f1-ce33bd6c7a06 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.566606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89889d9-d15d-4805-b8f1-ce33bd6c7a06 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.566892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89889d9-d15d-4805-b8f1-ce33bd6c7a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.587017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c89889d9-d15d-4805-b8f1-ce33bd6c7a06 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:12.589963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c89889d9-d15d-4805-b8f1-ce33bd6c7a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:12.681984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 935/1844] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:12.692781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa872e-2396-481e-bd0b-c9d3f323db1e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.693252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4575bd2-c26b-4380-a597-70c6ec064e12 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.693371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa872e-2396-481e-bd0b-c9d3f323db1e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.693594 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4575bd2-c26b-4380-a597-70c6ec064e12 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.693808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa872e-2396-481e-bd0b-c9d3f323db1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.693901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4575bd2-c26b-4380-a597-70c6ec064e12 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.695683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 936/1845] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:56:12.716369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c8fa872e-2396-481e-bd0b-c9d3f323db1e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:12.717641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c8fa872e-2396-481e-bd0b-c9d3f323db1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:12.723964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.725949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.726362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.738204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 910/1846] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:12.742809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa872e-2396-481e-bd0b-c9d3f323db1e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:12.757992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa872e-2396-481e-bd0b-c9d3f323db1e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:12.765629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:12.767398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.767844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.768347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.769204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:12.769420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:12.769862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:12.770701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:12.772506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:12.822126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 911/1847] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:56:12.826191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:12.841100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:12.863181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3ddb-87df-4494-a4b3-c54345ee4d48 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:12.876700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:12.877715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:12.878106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:12.878975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:12.880522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:12.883384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:12.887780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 937/1848] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:12.930508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:12.932166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:12.940020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 912/1849] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:12 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:12.941020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:12.957636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c827a05-5e82-407a-a2d5-3cf835206fb5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.059567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.060650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.061084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.061527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.078198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.078198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.078704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8430-f72e-42df-b581-cb99710b6a53 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.083878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.085380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.085768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.086215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.087171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.089479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.098048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 938/1850] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:13.116358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 913/1851] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:12 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:13.120571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.134172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2bd3-4def-44ce-a4b2-25da9fba32ad service nova] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.145739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.147129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.147428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.147715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.148466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.150498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.163475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 939/1852] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:13.167159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.178581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5f8c-15b3-4432-b110-e49759169854 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.183976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee6aa-23ca-4262-ad76-41e1a16bacae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.184856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee6aa-23ca-4262-ad76-41e1a16bacae admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.185139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee6aa-23ca-4262-ad76-41e1a16bacae admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.185416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee6aa-23ca-4262-ad76-41e1a16bacae admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.186144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcee6aa-23ca-4262-ad76-41e1a16bacae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.187734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcee6aa-23ca-4262-ad76-41e1a16bacae admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.199084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 914/1853] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:13.203661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.214953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af66105-2ea7-4cb6-87d1-f754871ea043 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.219736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.220661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.220954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.221239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] PATH_INFO: `/v3/projects/9d21dc4b408245ee9a4c41b959187681/users/87d3c8d9b4fd4e63a666ce45ebfc3fb4/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.238590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d21dc4b408245ee9a4c41b959187681, user_id=87d3c8d9b4fd4e63a666ce45ebfc3fb4, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.241332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.255549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 940/1854] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:13 2022] PUT /identity/v3/projects/9d21dc4b408245ee9a4c41b959187681/users/87d3c8d9b4fd4e63a666ce45ebfc3fb4/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:13.266828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb70b0-10eb-493d-9dd2-99df32c18a86 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.267120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb70b0-10eb-493d-9dd2-99df32c18a86 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.267400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb70b0-10eb-493d-9dd2-99df32c18a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.307055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-cceb70b0-10eb-493d-9dd2-99df32c18a86 None None] MFA Rules not processed for user `87d3c8d9b4fd4e63a666ce45ebfc3fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:13.308677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cceb70b0-10eb-493d-9dd2-99df32c18a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:13.367996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:13.410565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 915/1855] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:13.416109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.498023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec3b7e-7c48-487e-b098-f2ad6917a002 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.504148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.504934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.505287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.505636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.507216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.509526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.552785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 941/1856] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:13 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:13.556907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb70b0-10eb-493d-9dd2-99df32c18a86 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.567838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb70b0-10eb-493d-9dd2-99df32c18a86 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.639416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.640097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.640382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.640695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.641397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.643387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.663623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 916/1857] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:13 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:13.667608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.678135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abcf91-1ef6-49af-811a-74be007d877f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.683644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.684308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.684602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.684903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.685633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.687249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.698180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 942/1858] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:13.702190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.714556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08f88a-d5d2-43c3-a334-d4ee6349afd3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.719952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.720882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.721172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.721455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] PATH_INFO: `/v3/projects/1452f28d7b7b4ec6aff522e375c21210/users/9f587d8c233c4e1491884e1b6fcc6c80/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.736364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1452f28d7b7b4ec6aff522e375c21210, user_id=9f587d8c233c4e1491884e1b6fcc6c80, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.739083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.751957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 917/1859] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:13 2022] PUT /identity/v3/projects/1452f28d7b7b4ec6aff522e375c21210/users/9f587d8c233c4e1491884e1b6fcc6c80/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:13.756643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.766332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f80bd-2de5-42e3-b1a8-a3f1ea6dcb9e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.770920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:13.822993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6cb37-8cf0-45e9-8c85-7ef29c3f0223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.823650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6cb37-8cf0-45e9-8c85-7ef29c3f0223 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.823935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6cb37-8cf0-45e9-8c85-7ef29c3f0223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.824214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6cb37-8cf0-45e9-8c85-7ef29c3f0223 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.824970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6cb37-8cf0-45e9-8c85-7ef29c3f0223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.826563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6cb37-8cf0-45e9-8c85-7ef29c3f0223 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.836869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 943/1860] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:13.840893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:13.851160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2d5ac-4d56-4d12-afae-334d809d35b6 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:13.855838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:13.856764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.857055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.857335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] PATH_INFO: `/v3/projects/1452f28d7b7b4ec6aff522e375c21210/users/9f587d8c233c4e1491884e1b6fcc6c80/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.859322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1452f28d7b7b4ec6aff522e375c21210, user_id=9f587d8c233c4e1491884e1b6fcc6c80, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:13.862005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:13.872486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 918/1861] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:13 2022] PUT /identity/v3/projects/1452f28d7b7b4ec6aff522e375c21210/users/9f587d8c233c4e1491884e1b6fcc6c80/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:13.883114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:13.883406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:13.883687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:13.909247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] MFA Rules not processed for user `9f587d8c233c4e1491884e1b6fcc6c80`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:13.910438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:13.987837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 944/1862] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:13.999710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:14.001705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:14.063550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5ed18-7560-4d7b-931c-50d7e1cc2ab2 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:14.067298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:14.067955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:14.068243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:14.068607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:14.078736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:14.080198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:14.090139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 919/1863] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:14.135994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:14.137462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:14.149153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206dea7-81f0-4298-9bdd-98b0ce09d7cf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:14.152892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780b6f-39e6-44ec-a726-522486d7b059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:14.153534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780b6f-39e6-44ec-a726-522486d7b059 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:14.153823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780b6f-39e6-44ec-a726-522486d7b059 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:14.154108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780b6f-39e6-44ec-a726-522486d7b059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:14.216381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780b6f-39e6-44ec-a726-522486d7b059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:14.217865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780b6f-39e6-44ec-a726-522486d7b059 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:14.227315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 945/1864] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:15.908330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:15.910151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:15.982464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:16.031579 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a1c1-06a7-4f63-a6f4-b10e8138a97b service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:16.039554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:16.040782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:16.041387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:16.042585 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] PATH_INFO: `/v3/users/1b8675b65fcd44f39fa6913a185c7e9d` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:16.046000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8675b65fcd44f39fa6913a185c7e9d)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:16.048378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:16.142574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8675b65fcd44f39fa6913a185c7e9d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.143319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8675b65fcd44f39fa6913a185c7e9d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.178275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8675b65fcd44f39fa6913a185c7e9d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.189707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8675b65fcd44f39fa6913a185c7e9d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.195078 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8675b65fcd44f39fa6913a185c7e9d'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.226895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 920/1865] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:15 2022] DELETE /identity/v3/users/1b8675b65fcd44f39fa6913a185c7e9d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:16.231117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:16.232038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:16.232645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:16.263337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:16.264622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:16.264904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:16.266968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:16.302436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:16.366237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 946/1866] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:16.376201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:16.377782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:16.403301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba574-df26-41cb-8f16-2abce730296c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:16.415508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:16.416387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:16.416693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:16.416972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] PATH_INFO: `/v3/users/96b0aa11138b4b9cb5de0251aee643b3` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:16.418223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b0aa11138b4b9cb5de0251aee643b3)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:16.420373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:16.463706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb438c48-9237-4156-81fe-b71d8bf193a0 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:16.471546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c76cca-2e39-4512-b5bf-f27aa269f623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:16.472322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c76cca-2e39-4512-b5bf-f27aa269f623 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:16.472723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c76cca-2e39-4512-b5bf-f27aa269f623 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:16.473081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c76cca-2e39-4512-b5bf-f27aa269f623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:16.487288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b0aa11138b4b9cb5de0251aee643b3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.487500 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c76cca-2e39-4512-b5bf-f27aa269f623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:16.488377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b0aa11138b4b9cb5de0251aee643b3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.489218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c76cca-2e39-4512-b5bf-f27aa269f623 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:16.501915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 947/1867] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:16.509981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:16.516920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b0aa11138b4b9cb5de0251aee643b3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.526056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b0aa11138b4b9cb5de0251aee643b3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.527046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b0aa11138b4b9cb5de0251aee643b3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:16.544655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 921/1868] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:16 2022] DELETE /identity/v3/users/96b0aa11138b4b9cb5de0251aee643b3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:16.547995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:16.548302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:16.548607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:16.568096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:16.569927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:16.640567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 948/1869] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:16.651379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:16.652928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:16.734373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c17ec-e5f4-4797-9a16-c2883d8ad4d4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:16.738346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:16.739267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:16.739662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:16.740070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:16.752952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:16.754594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:16.767817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 922/1870] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:17.040453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:17.042146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:17.070244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c71bcd-f8e4-490d-acbf-74b41545d152 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:17.076426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:17.077352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:17.077633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:17.077911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] PATH_INFO: `/v3/projects/776fe1748775411c9a9dc5740d6b19b8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:17.082207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] RBAC: Authorizing `identity:delete_project(project_id=776fe1748775411c9a9dc5740d6b19b8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:17.084180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:17.138343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776fe1748775411c9a9dc5740d6b19b8', 'request_id': 'req-13015387-653c-49a4-9943-a96f9f45502c'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.138908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:17.140313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:17.146217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776fe1748775411c9a9dc5740d6b19b8', 'request_id': 'req-13015387-653c-49a4-9943-a96f9f45502c'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.156763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776fe1748775411c9a9dc5740d6b19b8', 'request_id': 'req-13015387-653c-49a4-9943-a96f9f45502c'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.160655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653105fb-9d3e-40d3-b4ab-3d0fe5d5c16a service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:17.161264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:17.176920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] The token cache is being invalidate because project 776fe1748775411c9a9dc5740d6b19b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:17.180096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.180096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.181883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 949/1871] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:17 2022] DELETE /identity/v3/projects/776fe1748775411c9a9dc5740d6b19b8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:17.185282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:17.186950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:17.283977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13015387-653c-49a4-9943-a96f9f45502c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:17.287991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:17.289224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:17.289652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:17.290076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] PATH_INFO: `/v3/projects/111f1739455a4db3b9cceba6b9c36551` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:17.291276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:17.292574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:17.292992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:17.293300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111f1739455a4db3b9cceba6b9c36551)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:17.293444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] PATH_INFO: `/v3/users/cae2fb78d1ac48b28840d24443a15e87` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:17.294798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae2fb78d1ac48b28840d24443a15e87)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:17.301703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:17.302248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:17.387652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111f1739455a4db3b9cceba6b9c36551', 'request_id': 'req-2c86613b-e3ce-474e-bd28-808dc32ebf28'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.400675 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111f1739455a4db3b9cceba6b9c36551', 'request_id': 'req-2c86613b-e3ce-474e-bd28-808dc32ebf28'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.406303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae2fb78d1ac48b28840d24443a15e87'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.408902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111f1739455a4db3b9cceba6b9c36551', 'request_id': 'req-2c86613b-e3ce-474e-bd28-808dc32ebf28'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.415289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae2fb78d1ac48b28840d24443a15e87'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.435905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] The token cache is being invalidate because project 111f1739455a4db3b9cceba6b9c36551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:17.436204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.436915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.437518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae2fb78d1ac48b28840d24443a15e87'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.438381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae2fb78d1ac48b28840d24443a15e87'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.438823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 923/1872] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:17 2022] DELETE /identity/v3/projects/111f1739455a4db3b9cceba6b9c36551 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:17.439425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae2fb78d1ac48b28840d24443a15e87'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.442436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:17.444432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:17.457132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:17.460209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 950/1873] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:17 2022] DELETE /identity/v3/users/cae2fb78d1ac48b28840d24443a15e87 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:17.530421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86613b-e3ce-474e-bd28-808dc32ebf28 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:17.610174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:17.611158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:17.611514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:17.611859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] PATH_INFO: `/v3/users/0d3491478e974d67864a0be7635cbf54` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:17.613464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3491478e974d67864a0be7635cbf54)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:17.616325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:17.689597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3491478e974d67864a0be7635cbf54'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.691157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3491478e974d67864a0be7635cbf54'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.707710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3491478e974d67864a0be7635cbf54'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.718462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3491478e974d67864a0be7635cbf54'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.719255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3491478e974d67864a0be7635cbf54'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:17.738467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 924/1874] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:17 2022] DELETE /identity/v3/users/0d3491478e974d67864a0be7635cbf54 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:17.833664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:17.836258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:17.864873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0fa1-e7c0-47ba-9ba2-7ea0761e17e7 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:17.924480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:17.926293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:17.938229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:17.939253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:17.939733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:17.940185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] PATH_INFO: `/v3/projects/fc253472be1545559d1dbe32d86586b0` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:17.941558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc253472be1545559d1dbe32d86586b0)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:17.943776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:17.967042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:17.992074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:18.026234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc253472be1545559d1dbe32d86586b0', 'request_id': 'req-c97f18fa-721e-4987-a27a-3c06f61ea6ba'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.032172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d47a8-8634-4968-bd6f-24e8eea80efe admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.034000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc253472be1545559d1dbe32d86586b0', 'request_id': 'req-c97f18fa-721e-4987-a27a-3c06f61ea6ba'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.044083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc253472be1545559d1dbe32d86586b0', 'request_id': 'req-c97f18fa-721e-4987-a27a-3c06f61ea6ba'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.060483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] The token cache is being invalidate because project fc253472be1545559d1dbe32d86586b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:18.061239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.061798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c97f18fa-721e-4987-a27a-3c06f61ea6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.063812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 951/1875] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:17 2022] DELETE /identity/v3/projects/fc253472be1545559d1dbe32d86586b0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:18.070235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.070530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.070810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.094193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:18.095408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.099402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.101138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.101670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.102184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] PATH_INFO: `/v3/users/87d3c8d9b4fd4e63a666ce45ebfc3fb4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.103677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d3c8d9b4fd4e63a666ce45ebfc3fb4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.105149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 952/1876] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:18.106088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.109457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.111859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.123661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca541a39-93dc-4c13-aa3d-80f8e2d1c6b1 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.129657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.130630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.131443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.131724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] PATH_INFO: `/v3/projects/8a49601a5ef74ebc90612bce010d37c5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.133204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a49601a5ef74ebc90612bce010d37c5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.135118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.167782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d3c8d9b4fd4e63a666ce45ebfc3fb4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.168476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d3c8d9b4fd4e63a666ce45ebfc3fb4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.181163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d3c8d9b4fd4e63a666ce45ebfc3fb4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.184204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a49601a5ef74ebc90612bce010d37c5', 'request_id': 'req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.188191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d3c8d9b4fd4e63a666ce45ebfc3fb4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.188895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-60bb1ace-6355-4da1-a5a3-ecbb1b94821a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d3c8d9b4fd4e63a666ce45ebfc3fb4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.189955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a49601a5ef74ebc90612bce010d37c5', 'request_id': 'req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.201546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a49601a5ef74ebc90612bce010d37c5', 'request_id': 'req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.205085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 925/1877] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:17 2022] DELETE /identity/v3/users/87d3c8d9b4fd4e63a666ce45ebfc3fb4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:18.206464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.206828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.207116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.217630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] The token cache is being invalidate because project 8a49601a5ef74ebc90612bce010d37c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:18.217630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.218074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-886d3bee-bc48-4395-ac33-a2b21ebeaf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.219675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 953/1878] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:18 2022] DELETE /identity/v3/projects/8a49601a5ef74ebc90612bce010d37c5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:18.222015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff499fdf-eabb-4bcf-aec8-eb0c2664ea45 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.222743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff499fdf-eabb-4bcf-aec8-eb0c2664ea45 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.222743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff499fdf-eabb-4bcf-aec8-eb0c2664ea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.226855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:18.228066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.239891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ff499fdf-eabb-4bcf-aec8-eb0c2664ea45 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:18.241131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ff499fdf-eabb-4bcf-aec8-eb0c2664ea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.279920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:18.290182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 926/1879] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:18.291297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.292811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.303900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 954/1880] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:18.304842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff499fdf-eabb-4bcf-aec8-eb0c2664ea45 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.305238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15af4cd-eeab-46f7-aa50-420d72d41855 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.313134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.314103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.314465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.314890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] PATH_INFO: `/v3/users/682dc296d0094ca794e9d93b4a9e4530` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.315349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff499fdf-eabb-4bcf-aec8-eb0c2664ea45 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.316443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=682dc296d0094ca794e9d93b4a9e4530)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.319378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.321444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.322110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.322400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.322683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.323448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:18.323761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.325403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.338985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 955/1881] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:18.339830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.341521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.352464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:18.376445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682dc296d0094ca794e9d93b4a9e4530'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.377154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682dc296d0094ca794e9d93b4a9e4530'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.390908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682dc296d0094ca794e9d93b4a9e4530'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.400081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682dc296d0094ca794e9d93b4a9e4530'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.400879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682dc296d0094ca794e9d93b4a9e4530'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:18.408515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9f6fe-7f2e-410f-852c-10b69e1fd78b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.412456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.413178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.414050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.414050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.415648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.416166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 927/1882] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:18 2022] DELETE /identity/v3/users/682dc296d0094ca794e9d93b4a9e4530 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:18.417080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.419261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.432610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.434066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.445003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 956/1883] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:18.505085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfccea-00a2-430e-b30c-cc4108390740 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.511967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.513483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.513770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.514054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.514829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.516853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.543300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 928/1884] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:18 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:18.547478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.558085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28553da5-3d87-44a7-a55b-1770d9b22f25 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.618343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.619046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.619338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.619626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.620370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.622358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.648067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 957/1885] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:18 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:18.649430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.660147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56eee-9f4b-4d55-ad51-2a1aef1e0919 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.665387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.666286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.666418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.666645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.667414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.669097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.681436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 929/1886] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:18.685438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.696654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa353-9478-4c4a-bfc2-d6510158e381 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.701481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677001b0-30b2-4ab8-8a4f-0fe8c2016619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.702168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677001b0-30b2-4ab8-8a4f-0fe8c2016619 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.702458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677001b0-30b2-4ab8-8a4f-0fe8c2016619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.702770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677001b0-30b2-4ab8-8a4f-0fe8c2016619 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.703480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677001b0-30b2-4ab8-8a4f-0fe8c2016619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.705340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677001b0-30b2-4ab8-8a4f-0fe8c2016619 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.720221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 958/1887] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:18.721861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.733128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461025bb-7687-4958-927a-c585b00dcbfd admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.737909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.738833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.739117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.739392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] PATH_INFO: `/v3/projects/e0ef32af0621413e9c8005433e7544b8/users/664281383a094726b4ad73e19e9b7cc9/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.755670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ef32af0621413e9c8005433e7544b8, user_id=664281383a094726b4ad73e19e9b7cc9, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.758586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:18.772925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 930/1888] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:18 2022] PUT /identity/v3/projects/e0ef32af0621413e9c8005433e7544b8/users/664281383a094726b4ad73e19e9b7cc9/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:18.782960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f44936-4299-4539-a7fa-205861118d82 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.783263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f44936-4299-4539-a7fa-205861118d82 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.783551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f44936-4299-4539-a7fa-205861118d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.813116 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-34f44936-4299-4539-a7fa-205861118d82 None None] MFA Rules not processed for user `664281383a094726b4ad73e19e9b7cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:18.814532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-34f44936-4299-4539-a7fa-205861118d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:18.885729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 959/1889] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:18.890110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:18.918444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:18.960794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d699-fb20-4a47-8144-72c2b2f08c62 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:18.966028 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:18.966696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:18.966979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:18.967257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:18.967969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:18.970062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.018023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 931/1890] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:18 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:19.019773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f44936-4299-4539-a7fa-205861118d82 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.034649 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f44936-4299-4539-a7fa-205861118d82 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.089834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:19.142418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.143138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.143392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.143672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.144375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.147949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.191214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 960/1891] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:19 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:19.195449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.223308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff451e8-6875-4882-aed2-1cd36d1202a3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.229522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.230385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.230842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.231252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.232344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.246169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.263718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 932/1892] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:19.267606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.280726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0db98-d230-49fa-abba-40d0faad9c45 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.285690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.286702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.287083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.287955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] PATH_INFO: `/v3/projects/0f4ce613431e4d4ca3a494871c5c62dd/users/4866d9a9257b4de6b9d8ba37714eeebb/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.305592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4ce613431e4d4ca3a494871c5c62dd, user_id=4866d9a9257b4de6b9d8ba37714eeebb, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.308178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.324500 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 961/1893] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:19 2022] PUT /identity/v3/projects/0f4ce613431e4d4ca3a494871c5c62dd/users/4866d9a9257b4de6b9d8ba37714eeebb/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:19.329005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.341207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.343584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:19.362105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496dd3-90e2-4e5e-9079-0f2f728e7f72 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.464616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ced52f-83a4-4223-b8be-9a574ff0a5fe admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.465320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.466017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.466301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.466711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.467447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.469141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.470043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.471082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.472125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.472414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] PATH_INFO: `/v3/projects/85733c182eb943bcba804a8bfd80e664` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.473919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85733c182eb943bcba804a8bfd80e664)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.477011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.485217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 933/1894] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:19.485217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.485475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:19.548057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85733c182eb943bcba804a8bfd80e664', 'request_id': 'req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:19.556304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85733c182eb943bcba804a8bfd80e664', 'request_id': 'req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:19.573313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85733c182eb943bcba804a8bfd80e664', 'request_id': 'req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:19.574387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ba23d-c5b0-4448-97d3-ce953552c109 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.594757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] The token cache is being invalidate because project 85733c182eb943bcba804a8bfd80e664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:19.595110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:19.596968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:19.599731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 962/1895] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:19 2022] DELETE /identity/v3/projects/85733c182eb943bcba804a8bfd80e664 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:19.600501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.603984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:19.650953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:19.698167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:19.706102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.707288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.708881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.710547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.713632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:19.737495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4edfa3-e4e1-468a-93e4-6d911d6fbcd7 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.745731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f403fcc-3528-4b7c-8121-0bd3d4da9acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.747589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403fcc-3528-4b7c-8121-0bd3d4da9acb admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.748415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403fcc-3528-4b7c-8121-0bd3d4da9acb admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.748910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403fcc-3528-4b7c-8121-0bd3d4da9acb admin admin] PATH_INFO: `/v3/projects/0f4ce613431e4d4ca3a494871c5c62dd/users/4866d9a9257b4de6b9d8ba37714eeebb/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.752464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403fcc-3528-4b7c-8121-0bd3d4da9acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4ce613431e4d4ca3a494871c5c62dd, user_id=4866d9a9257b4de6b9d8ba37714eeebb, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.757358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403fcc-3528-4b7c-8121-0bd3d4da9acb admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.776217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 963/1896] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:19 2022] PUT /identity/v3/projects/0f4ce613431e4d4ca3a494871c5c62dd/users/4866d9a9257b4de6b9d8ba37714eeebb/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:19.791001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406eba-03ee-456b-8caf-f925cdab30c4 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.791563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406eba-03ee-456b-8caf-f925cdab30c4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.791996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406eba-03ee-456b-8caf-f925cdab30c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.802759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.804613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:19.817228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-44406eba-03ee-456b-8caf-f925cdab30c4 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:19.818800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 934/1897] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:19.819083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-44406eba-03ee-456b-8caf-f925cdab30c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:19.820037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:19.821835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:19.851592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8b1e7-221d-4249-a94e-18e5fce4fd78 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:19.896404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 964/1898] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:19.897915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462422-a637-4df9-a129-5430c8ad2560 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.898241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462422-a637-4df9-a129-5430c8ad2560 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.898500 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462422-a637-4df9-a129-5430c8ad2560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.935886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-fc462422-a637-4df9-a129-5430c8ad2560 None None] MFA Rules not processed for user `4866d9a9257b4de6b9d8ba37714eeebb`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:19.937174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fc462422-a637-4df9-a129-5430c8ad2560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:19.955354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:19.955354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:19.955750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:19.956116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] PATH_INFO: `/v3/projects/9d21dc4b408245ee9a4c41b959187681` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:19.957667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d21dc4b408245ee9a4c41b959187681)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:19.963887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.046951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 965/1899] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:20.054368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.054669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.055272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.074110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d21dc4b408245ee9a4c41b959187681', 'request_id': 'req-92367759-867a-4363-9f5b-48704e69d7d4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.095787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:20.098153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d21dc4b408245ee9a4c41b959187681', 'request_id': 'req-92367759-867a-4363-9f5b-48704e69d7d4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.105728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.107630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d21dc4b408245ee9a4c41b959187681', 'request_id': 'req-92367759-867a-4363-9f5b-48704e69d7d4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.135258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] The token cache is being invalidate because project 9d21dc4b408245ee9a4c41b959187681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:20.136469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.139659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.141473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 935/1900] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:19 2022] DELETE /identity/v3/projects/9d21dc4b408245ee9a4c41b959187681 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:20.143865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.148251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.189781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:20.236275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:20.260515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 966/1901] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:20.261721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.268385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.285320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dd4ac-9469-4997-ac4a-104ae44a7425 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.291075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.291757 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92367759-867a-4363-9f5b-48704e69d7d4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.291856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.292145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.292422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] PATH_INFO: `/v3/users/9f587d8c233c4e1491884e1b6fcc6c80` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.293870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f587d8c233c4e1491884e1b6fcc6c80)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.295802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.304148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.304857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.305176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.305481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.307570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.367568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f587d8c233c4e1491884e1b6fcc6c80'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.377161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f587d8c233c4e1491884e1b6fcc6c80'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.395901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f587d8c233c4e1491884e1b6fcc6c80'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.396788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f587d8c233c4e1491884e1b6fcc6c80'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.397507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f587d8c233c4e1491884e1b6fcc6c80'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.411791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 967/1902] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:20 2022] DELETE /identity/v3/users/9f587d8c233c4e1491884e1b6fcc6c80 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:20.413668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.421676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.429211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.430820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.444344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 936/1903] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:20.535657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a439-96af-46ce-93c2-8ef329653f28 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.544549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.545780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.546047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.546431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.547409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:20.547986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.552118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.571747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 968/1904] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:20.578042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.594922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9828cd-1bb3-42fd-aa74-aea667ad3ebc service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.600651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.601412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.601766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.602362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.603301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.605514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.635090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.636445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.651316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975a78-c2d7-4b56-8f0f-008a4e7433a9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.656802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.657884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.659393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.659865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] PATH_INFO: `/v3/users/664281383a094726b4ad73e19e9b7cc9` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.661373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] RBAC: Authorizing `identity:delete_user(user_id=664281383a094726b4ad73e19e9b7cc9)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.663958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.675667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 937/1905] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:20 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:20.683564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.731590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:20.747420 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664281383a094726b4ad73e19e9b7cc9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.754523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9028-f704-4d92-96d1-4b07e808699e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.758004 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664281383a094726b4ad73e19e9b7cc9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.762858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3500e-6f5e-4da5-9af5-7a15eeb166cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.764021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3500e-6f5e-4da5-9af5-7a15eeb166cb admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.764575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3500e-6f5e-4da5-9af5-7a15eeb166cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.764941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3500e-6f5e-4da5-9af5-7a15eeb166cb admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.765781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3500e-6f5e-4da5-9af5-7a15eeb166cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.768525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3500e-6f5e-4da5-9af5-7a15eeb166cb admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.774736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664281383a094726b4ad73e19e9b7cc9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.776008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664281383a094726b4ad73e19e9b7cc9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.776920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664281383a094726b4ad73e19e9b7cc9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:20.799288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 969/1906] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:20 2022] DELETE /identity/v3/users/664281383a094726b4ad73e19e9b7cc9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:20.800747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 938/1907] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:20 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:20.807607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.808360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.809318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.809818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.810580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.847478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:20.848720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.907694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:20.912127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75295f84-57d9-4a2e-8bae-06e98a7a072e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.917692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.918356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.918642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.918917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.919785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.921403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.927831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 939/1908] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:20.928803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.930052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:20.934285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 970/1909] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:20.935141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.942787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c9ca5-1676-4f1e-b379-68493ee48170 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.944727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9b176-55e3-4d73-b472-125e0864f4da admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:20.947422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.948286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.948570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.948911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] PATH_INFO: `/v3/projects/1452f28d7b7b4ec6aff522e375c21210` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.949294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:20.949967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:20.950110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1452f28d7b7b4ec6aff522e375c21210)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.950247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:20.950515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:20.951226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:20.952025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.952805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:20.963425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 971/1910] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:20.964214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:20.965854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.004405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1452f28d7b7b4ec6aff522e375c21210', 'request_id': 'req-4f9be95a-61b6-4d07-a9a9-5221010c25cf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.013316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1452f28d7b7b4ec6aff522e375c21210', 'request_id': 'req-4f9be95a-61b6-4d07-a9a9-5221010c25cf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.021102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1452f28d7b7b4ec6aff522e375c21210', 'request_id': 'req-4f9be95a-61b6-4d07-a9a9-5221010c25cf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.024950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b79d80-9fba-42bd-a13f-2b43255cb4a3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.034676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] The token cache is being invalidate because project 1452f28d7b7b4ec6aff522e375c21210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:21.034972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.035646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.037234 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 940/1911] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:20 2022] DELETE /identity/v3/projects/1452f28d7b7b4ec6aff522e375c21210 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:21.040458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.040458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.078985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cad4d0-8270-48a0-8438-58a6a355d5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.079638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cad4d0-8270-48a0-8438-58a6a355d5fa service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.079924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cad4d0-8270-48a0-8438-58a6a355d5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.080205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cad4d0-8270-48a0-8438-58a6a355d5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.082187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-06cad4d0-8270-48a0-8438-58a6a355d5fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.092837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:21.106572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be95a-61b6-4d07-a9a9-5221010c25cf admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.111347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3def5-b23f-4bf7-ac75-f588ba0ccdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.112238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3def5-b23f-4bf7-ac75-f588ba0ccdf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.112528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3def5-b23f-4bf7-ac75-f588ba0ccdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.112836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3def5-b23f-4bf7-ac75-f588ba0ccdf7 admin admin] PATH_INFO: `/v3/projects/fd973d4aaa2245bc97bad2a8d77d7f23/users/7f7b2294e6c149e6897237407a944c5c/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.128561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3def5-b23f-4bf7-ac75-f588ba0ccdf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd973d4aaa2245bc97bad2a8d77d7f23, user_id=7f7b2294e6c149e6897237407a944c5c, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.131807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3def5-b23f-4bf7-ac75-f588ba0ccdf7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.144994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 941/1912] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:21 2022] PUT /identity/v3/projects/fd973d4aaa2245bc97bad2a8d77d7f23/users/7f7b2294e6c149e6897237407a944c5c/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:21.152105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cad4d0-8270-48a0-8438-58a6a355d5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.153580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cad4d0-8270-48a0-8438-58a6a355d5fa service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.156370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef2d28-0014-46d1-bba9-3dfe78d0ff87 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.156698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef2d28-0014-46d1-bba9-3dfe78d0ff87 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.156991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef2d28-0014-46d1-bba9-3dfe78d0ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.164257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 972/1913] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:21.165585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2cc9-c4dc-4eaf-b3a7-0e46890c9ff5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.165876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2cc9-c4dc-4eaf-b3a7-0e46890c9ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.166224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2cc9-c4dc-4eaf-b3a7-0e46890c9ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.176902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9cef2d28-0014-46d1-bba9-3dfe78d0ff87 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:21.178253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9cef2d28-0014-46d1-bba9-3dfe78d0ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.199475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9f3f2cc9-c4dc-4eaf-b3a7-0e46890c9ff5 None None] MFA Rules not processed for user `7f7b2294e6c149e6897237407a944c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:21.200701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9f3f2cc9-c4dc-4eaf-b3a7-0e46890c9ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.247083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:21.268084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 942/1914] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:21.270323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca477f-87e1-41b5-81db-da908ccf2243 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.270577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca477f-87e1-41b5-81db-da908ccf2243 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.270893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca477f-87e1-41b5-81db-da908ccf2243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.287971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 973/1915] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:21.292371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2cc9-c4dc-4eaf-b3a7-0e46890c9ff5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.292939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-70ca477f-87e1-41b5-81db-da908ccf2243 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:21.294441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-70ca477f-87e1-41b5-81db-da908ccf2243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.303517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2cc9-c4dc-4eaf-b3a7-0e46890c9ff5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.303780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 943/1916] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:21.307651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca477f-87e1-41b5-81db-da908ccf2243 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.308445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.309143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.309432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.309715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.310426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.312337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.327534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca477f-87e1-41b5-81db-da908ccf2243 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.334836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.335595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.335890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.336172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.337007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:21.337322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.339010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.344689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 974/1917] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:21.348204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.361566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 944/1918] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:56:21.366500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.381622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0acf65-e89d-418a-a363-300c31b63319 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.436685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33752c-7ddd-445e-8b9b-c55170ebc205 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.442326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.443228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.444180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.444562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.445396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.447534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.451624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.452296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.452607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.452893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.453594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.455796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.483389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 975/1919] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:21.484498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.497993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.507037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 945/1920] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:21.507978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.509562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:21.517089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5e48-161b-4218-937c-24d38c0f7473 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.578650 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63019d-bd9d-4dc2-8d61-da897fa84315 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.585060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.585750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.586045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.586335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.587073 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.588758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.593397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.594286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.595142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.595378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] PATH_INFO: `/v3/projects/e0ef32af0621413e9c8005433e7544b8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.596609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ef32af0621413e9c8005433e7544b8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.598710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.599632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 946/1921] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:21.600344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.613058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0ccd-9436-4867-b35d-ace974bb9c33 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.619454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.620561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.620977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.621589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.622805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.625128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.650348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 947/1922] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:21.651398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.662100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ef32af0621413e9c8005433e7544b8', 'request_id': 'req-38ce7525-47cf-483f-bcd1-7155d374b648'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.662362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd58-3e31-4c38-9d8d-f4ba1458eb74 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.673614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ef32af0621413e9c8005433e7544b8', 'request_id': 'req-38ce7525-47cf-483f-bcd1-7155d374b648'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.688190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ef32af0621413e9c8005433e7544b8', 'request_id': 'req-38ce7525-47cf-483f-bcd1-7155d374b648'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.705370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] The token cache is being invalidate because project e0ef32af0621413e9c8005433e7544b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:21.705667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.706364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.708214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 976/1923] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:21 2022] DELETE /identity/v3/projects/e0ef32af0621413e9c8005433e7544b8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:21.709208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.712275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.716418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:21.745680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.746721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.747084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.747439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] PATH_INFO: `/v3/projects/3eea943a872546b98cf08ad5d0b016cc/users/89add0392de0411d8623cc0a1c376654/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.765622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eea943a872546b98cf08ad5d0b016cc, user_id=89add0392de0411d8623cc0a1c376654, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.768665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.783967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 948/1924] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:21 2022] PUT /identity/v3/projects/3eea943a872546b98cf08ad5d0b016cc/users/89add0392de0411d8623cc0a1c376654/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:21.784680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.785148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7525-47cf-483f-bcd1-7155d374b648 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.786560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.831732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:21.855282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.855959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.856276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.856622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.857313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.858941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.870904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 977/1925] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:21.871328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ec538-82a5-443e-b39f-53fd5ca5c192 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.872265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.873695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.877852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.878959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.879303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.879652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] PATH_INFO: `/v3/users/4866d9a9257b4de6b9d8ba37714eeebb` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.881020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4866d9a9257b4de6b9d8ba37714eeebb)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.883088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.887657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a70c9-6bfb-40be-ab40-01b457307225 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.892540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.893303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.893662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.894012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.894836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.896970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.910892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 978/1926] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:21.911972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.923547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc207ec3-6134-47eb-819f-6c426a9f1ee0 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.929926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.930662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.931076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.931459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.932292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.933989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.945695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4866d9a9257b4de6b9d8ba37714eeebb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.946493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4866d9a9257b4de6b9d8ba37714eeebb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.947717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 979/1927] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:21.948598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.950378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.960600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4866d9a9257b4de6b9d8ba37714eeebb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.963401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333c0bd-c27e-489d-b818-dfd80975bec7 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:21.967862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4866d9a9257b4de6b9d8ba37714eeebb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.968445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694037bb-f218-46ce-8154-13edb39ecddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:21.968569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4866d9a9257b4de6b9d8ba37714eeebb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:21.969556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694037bb-f218-46ce-8154-13edb39ecddf admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:21.969929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694037bb-f218-46ce-8154-13edb39ecddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:21.970360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694037bb-f218-46ce-8154-13edb39ecddf admin admin] PATH_INFO: `/v3/projects/3eea943a872546b98cf08ad5d0b016cc/users/89add0392de0411d8623cc0a1c376654/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:21.972416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694037bb-f218-46ce-8154-13edb39ecddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eea943a872546b98cf08ad5d0b016cc, user_id=89add0392de0411d8623cc0a1c376654, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:21.976103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694037bb-f218-46ce-8154-13edb39ecddf admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:21.983847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 949/1928] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:21 2022] DELETE /identity/v3/users/4866d9a9257b4de6b9d8ba37714eeebb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:21.984692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:21.986066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:21.991559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 980/1929] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:21 2022] PUT /identity/v3/projects/3eea943a872546b98cf08ad5d0b016cc/users/89add0392de0411d8623cc0a1c376654/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:22.001707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf101-1977-4022-9b40-a023fb89052e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.002080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf101-1977-4022-9b40-a023fb89052e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.002424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf101-1977-4022-9b40-a023fb89052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.034581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-522cf101-1977-4022-9b40-a023fb89052e None None] MFA Rules not processed for user `89add0392de0411d8623cc0a1c376654`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:22.035613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:22.036104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-522cf101-1977-4022-9b40-a023fb89052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.070525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba387cc-84c3-43a2-9064-ed512aab0f48 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.075431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d532a-baf0-4ebc-912e-5eaaa68b479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.076375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d532a-baf0-4ebc-912e-5eaaa68b479d admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.076816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d532a-baf0-4ebc-912e-5eaaa68b479d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.077093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d532a-baf0-4ebc-912e-5eaaa68b479d admin admin] PATH_INFO: `/v3/projects/764026592dc04f3fb7e13ab247a92b2b/users/d916d92410f24ceca5d849ceea876252/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.093682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d532a-baf0-4ebc-912e-5eaaa68b479d admin admin] RBAC: Authorizing `identity:create_grant(project_id=764026592dc04f3fb7e13ab247a92b2b, user_id=d916d92410f24ceca5d849ceea876252, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.096373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d532a-baf0-4ebc-912e-5eaaa68b479d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.123078 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 950/1930] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:21 2022] PUT /identity/v3/projects/764026592dc04f3fb7e13ab247a92b2b/users/d916d92410f24ceca5d849ceea876252/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:22.123261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 981/1931] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:22.126159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdfef-3bd1-4b0c-85c0-2fbc3b916ae3 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.126159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdfef-3bd1-4b0c-85c0-2fbc3b916ae3 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.126560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fdfef-3bd1-4b0c-85c0-2fbc3b916ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.136721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf101-1977-4022-9b40-a023fb89052e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.147817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-522cf101-1977-4022-9b40-a023fb89052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.156944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-600fdfef-3bd1-4b0c-85c0-2fbc3b916ae3 None None] MFA Rules not processed for user `d916d92410f24ceca5d849ceea876252`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:22.158159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-600fdfef-3bd1-4b0c-85c0-2fbc3b916ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.219765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf101-1977-4022-9b40-a023fb89052e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.253639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 951/1932] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:22.258547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdfef-3bd1-4b0c-85c0-2fbc3b916ae3 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.263631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:22.277863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.278596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.278886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.279187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.333342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fdfef-3bd1-4b0c-85c0-2fbc3b916ae3 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.338414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.339093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.339381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.339665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.340366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.342353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.349130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.350609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.360750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 982/1933] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:22.361863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.363305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.377334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 952/1934] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:22 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:22.381658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4b53-963b-4142-83c3-114f2342d915 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.381950 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.438118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:22.457119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.458067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.458359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.458689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] PATH_INFO: `/v3/projects/0f4ce613431e4d4ca3a494871c5c62dd` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.459922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4ce613431e4d4ca3a494871c5c62dd)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.462049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.467426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1599e1-8fa7-4b6c-a863-7db0d2cb0aa5 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.473859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.475085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.475404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.475691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.476384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.478841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.499569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 953/1935] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:22 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:22.500419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.521804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4ce613431e4d4ca3a494871c5c62dd', 'request_id': 'req-4a6d951f-0ff8-41ed-9080-2181ee77451b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:22.527349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4ce613431e4d4ca3a494871c5c62dd', 'request_id': 'req-4a6d951f-0ff8-41ed-9080-2181ee77451b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:22.535499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4ce613431e4d4ca3a494871c5c62dd', 'request_id': 'req-4a6d951f-0ff8-41ed-9080-2181ee77451b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:22.547736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] The token cache is being invalidate because project 0f4ce613431e4d4ca3a494871c5c62dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:22.548056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:22.548827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:22.550670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 983/1936] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:22 2022] DELETE /identity/v3/projects/0f4ce613431e4d4ca3a494871c5c62dd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:22.554555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.554555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.558217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc461-624f-449c-bb1f-fc06947d0846 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.579320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:22.609309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c3e90-2c9e-4f21-b9bd-e662ded6c48d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.609963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3e90-2c9e-4f21-b9bd-e662ded6c48d service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.610252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3e90-2c9e-4f21-b9bd-e662ded6c48d service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.610529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3e90-2c9e-4f21-b9bd-e662ded6c48d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.612388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-334c3e90-2c9e-4f21-b9bd-e662ded6c48d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.620596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d951f-0ff8-41ed-9080-2181ee77451b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.626744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a905a3b-7a6a-43fe-8950-d2d231a937b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.627379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905a3b-7a6a-43fe-8950-d2d231a937b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.627665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905a3b-7a6a-43fe-8950-d2d231a937b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.627947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905a3b-7a6a-43fe-8950-d2d231a937b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.628709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a905a3b-7a6a-43fe-8950-d2d231a937b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.630309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a905a3b-7a6a-43fe-8950-d2d231a937b2 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.640187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 984/1937] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:22.641584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d11df0-2204-40b3-a8f1-ef8ea24dba46 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.641878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d11df0-2204-40b3-a8f1-ef8ea24dba46 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.642159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d11df0-2204-40b3-a8f1-ef8ea24dba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.660031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a5d11df0-2204-40b3-a8f1-ef8ea24dba46 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:22.661304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a5d11df0-2204-40b3-a8f1-ef8ea24dba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.670077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 985/1938] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:22.670829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d11df0-2204-40b3-a8f1-ef8ea24dba46 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.680659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c3e90-2c9e-4f21-b9bd-e662ded6c48d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.682156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c3e90-2c9e-4f21-b9bd-e662ded6c48d service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.686200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d11df0-2204-40b3-a8f1-ef8ea24dba46 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.690815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.691297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 954/1939] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:22.691695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.691982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.692261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] PATH_INFO: `/v3/projects/a27a7816b4af453fb53844372303bb26/users/09297744d09842a2b34c390156c240af/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.693484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8f9c3-c851-43e1-9dcc-31d7a2d1ea68 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.693779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8f9c3-c851-43e1-9dcc-31d7a2d1ea68 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.694072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8f9c3-c851-43e1-9dcc-31d7a2d1ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.709549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27a7816b4af453fb53844372303bb26, user_id=09297744d09842a2b34c390156c240af, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.712626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.718869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a0e8f9c3-c851-43e1-9dcc-31d7a2d1ea68 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:22.718869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a0e8f9c3-c851-43e1-9dcc-31d7a2d1ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:22.730624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 955/1940] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:22.732021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8f9c3-c851-43e1-9dcc-31d7a2d1ea68 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.745089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 986/1941] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:22 2022] PUT /identity/v3/projects/a27a7816b4af453fb53844372303bb26/users/09297744d09842a2b34c390156c240af/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:22.747885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8f9c3-c851-43e1-9dcc-31d7a2d1ea68 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.749290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.791879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:22.848980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.850971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.851657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.852187 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.853659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:22.854220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.858999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.864070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1b44b-e74a-4d37-ab3a-e59f7a79d57d admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.877980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.878710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.878973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.879256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.880050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.882474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.889173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 956/1942] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:22.893635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.900436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 987/1943] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:22.905582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:22.925724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4e54d-d3a6-41de-a390-43da6db832b0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.925964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2da5f-9c32-4224-b99a-f749a2cfb402 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:22.934794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.934958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c6883-1ad9-4511-ae14-a80b6ae2c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:22.935730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.936111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.936506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.936941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6883-1ad9-4511-ae14-a80b6ae2c102 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.937234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6883-1ad9-4511-ae14-a80b6ae2c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.937513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.937630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c6883-1ad9-4511-ae14-a80b6ae2c102 admin admin] PATH_INFO: `/v3/projects/a27a7816b4af453fb53844372303bb26/users/09297744d09842a2b34c390156c240af/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.939695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.940281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c6883-1ad9-4511-ae14-a80b6ae2c102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27a7816b4af453fb53844372303bb26, user_id=09297744d09842a2b34c390156c240af, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:22.944474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c6883-1ad9-4511-ae14-a80b6ae2c102 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:22.966064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 988/1944] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:22 2022] PUT /identity/v3/projects/a27a7816b4af453fb53844372303bb26/users/09297744d09842a2b34c390156c240af/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:22.977726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206395e-8359-41b7-9d6c-0021d0d3d1cb None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:22.978028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206395e-8359-41b7-9d6c-0021d0d3d1cb None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:22.978358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206395e-8359-41b7-9d6c-0021d0d3d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:22.999074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 957/1945] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:22 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:23.003537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.038249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7206395e-8359-41b7-9d6c-0021d0d3d1cb None None] MFA Rules not processed for user `09297744d09842a2b34c390156c240af`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:23.044261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7206395e-8359-41b7-9d6c-0021d0d3d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.123176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d834745-375b-4ced-b230-9e65709fcce2 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.129052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.130260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.130548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.130881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.131589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.133597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.148148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:23.159181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 958/1946] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:23 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:23.159694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 989/1947] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:23.164625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.164625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.164772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206395e-8359-41b7-9d6c-0021d0d3d1cb None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.176486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206395e-8359-41b7-9d6c-0021d0d3d1cb None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.176819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78646d-a29d-42ae-91bf-015ae57204f6 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.181957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.182114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.182783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.182912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.183126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.183223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.183409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] PATH_INFO: `/v3/users/7f7b2294e6c149e6897237407a944c5c` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.183507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.184300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.184682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7b2294e6c149e6897237407a944c5c)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.186103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.186617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.202405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 990/1948] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:23.202405 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.204279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.258097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7b2294e6c149e6897237407a944c5c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.258817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7b2294e6c149e6897237407a944c5c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.269194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06f9c8-6444-495c-953c-0c060b3fb454 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.270741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7b2294e6c149e6897237407a944c5c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.275241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef60499-5a23-42f5-81ad-c16adaabb902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.275966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60499-5a23-42f5-81ad-c16adaabb902 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.276178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60499-5a23-42f5-81ad-c16adaabb902 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.276460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60499-5a23-42f5-81ad-c16adaabb902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.278328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2ef60499-5a23-42f5-81ad-c16adaabb902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.278591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7b2294e6c149e6897237407a944c5c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.279384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7b2294e6c149e6897237407a944c5c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.291547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef60499-5a23-42f5-81ad-c16adaabb902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.293048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef60499-5a23-42f5-81ad-c16adaabb902 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.293269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 959/1949] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:23 2022] DELETE /identity/v3/users/7f7b2294e6c149e6897237407a944c5c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:23.294216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.295665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.302450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:23.303314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 991/1950] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:23.304440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.304901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.305179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.324155 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:23.325884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.396869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342227ec-6874-43c0-8910-0476f2e6b6bc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.402168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.402616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.402905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.403224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.403557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 992/1951] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:23.403961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.404408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.405654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.414424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.418348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 960/1952] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:23.422312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.424919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.427095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235e0d8-61b9-4ca9-bea3-c5e64da8c745 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.432025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.433271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.433572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.433859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] PATH_INFO: `/v3/users/d916d92410f24ceca5d849ceea876252` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.435100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d916d92410f24ceca5d849ceea876252)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.437327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.505916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd916d92410f24ceca5d849ceea876252'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.515960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd916d92410f24ceca5d849ceea876252'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.520396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325aba-deb4-47ca-868c-a8b9d12b9da7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.527912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.529197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.529705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.530372 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.532718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd916d92410f24ceca5d849ceea876252'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.533547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd916d92410f24ceca5d849ceea876252'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.534502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-658e0690-7335-4ffd-a9d0-ec78957c2a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd916d92410f24ceca5d849ceea876252'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:23.543260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.544891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.550448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:23.556223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 961/1953] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:23.557198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 993/1954] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:23 2022] DELETE /identity/v3/users/d916d92410f24ceca5d849ceea876252 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:23.557322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.561554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.561930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.562664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.567951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c43153-ec01-4713-bc98-1eff1f2ceb45 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.586579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:23.587812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.654771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68f526-7d7a-4b0b-a9b4-f06f7e2b51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.655695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68f526-7d7a-4b0b-a9b4-f06f7e2b51c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.656157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68f526-7d7a-4b0b-a9b4-f06f7e2b51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.656447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68f526-7d7a-4b0b-a9b4-f06f7e2b51c1 admin admin] PATH_INFO: `/v3/projects/8024fb8d59cb41979823c5ae048980ac/users/efcacef911eb497e91db8bbd95d6f9e9/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.677088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68f526-7d7a-4b0b-a9b4-f06f7e2b51c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8024fb8d59cb41979823c5ae048980ac, user_id=efcacef911eb497e91db8bbd95d6f9e9, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.679968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68f526-7d7a-4b0b-a9b4-f06f7e2b51c1 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.680734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 994/1955] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:23.696083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 962/1956] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:23 2022] PUT /identity/v3/projects/8024fb8d59cb41979823c5ae048980ac/users/efcacef911eb497e91db8bbd95d6f9e9/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:23.705926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.706936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.707652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.708088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.708456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.743156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] MFA Rules not processed for user `efcacef911eb497e91db8bbd95d6f9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:23.744966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.762267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:23.827186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f116e43-14ba-4a7d-8126-5423f81bafc6 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.839833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 963/1957] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:23.854335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.855886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:23.909564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.911489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.911922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.912983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.941621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da83197-c95b-4a07-9222-8d8dbe0ced29 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:23.946229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:23.947016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:23.947715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:23.947715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:23.958709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:23.961560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:23.976081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 964/1958] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:23.977302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:23.979373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:24.035323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:24.036850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:24.055507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 995/1959] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:24.056452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:24.058365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:24.090760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9fc9e-b528-4825-9ad1-d181d154ae17 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:24.091632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a5f0a-5b89-412b-bf75-e374239b23a4 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:24.123859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:24.125618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:24.127475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:24.129929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:24.130871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:24.131619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] PATH_INFO: `/v3/users/efcacef911eb497e91db8bbd95d6f9e9` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:24.131778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:24.132198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] PATH_INFO: `/v3/projects/fd973d4aaa2245bc97bad2a8d77d7f23` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:24.137005 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=efcacef911eb497e91db8bbd95d6f9e9)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:24.138634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd973d4aaa2245bc97bad2a8d77d7f23)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:24.146932 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:24.147486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:24.156767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:24.253506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efcacef911eb497e91db8bbd95d6f9e9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.264968 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd973d4aaa2245bc97bad2a8d77d7f23', 'request_id': 'req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.265494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efcacef911eb497e91db8bbd95d6f9e9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.274737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd973d4aaa2245bc97bad2a8d77d7f23', 'request_id': 'req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.285635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efcacef911eb497e91db8bbd95d6f9e9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.286541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:24.286653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efcacef911eb497e91db8bbd95d6f9e9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.288333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-228c326f-74e6-49f9-a20b-238c2d60f1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efcacef911eb497e91db8bbd95d6f9e9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.290144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd973d4aaa2245bc97bad2a8d77d7f23', 'request_id': 'req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.308479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] The token cache is being invalidate because project fd973d4aaa2245bc97bad2a8d77d7f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:24.308832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.309780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.311927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 965/1960] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:23 2022] DELETE /identity/v3/projects/fd973d4aaa2245bc97bad2a8d77d7f23 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:24.313034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 996/1961] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:24 2022] DELETE /identity/v3/users/efcacef911eb497e91db8bbd95d6f9e9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:24.315861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:24.317059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:24.317338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:24.317559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:24.317947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:24.345063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:24.346466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:24.456869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a07c3a-f190-4fcb-9df8-cfb72ddde8e8 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:24.512634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 997/1962] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:24.538397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:24.540481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:24.562218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:24.563116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:24.563426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:24.563665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] PATH_INFO: `/v3/users/89add0392de0411d8623cc0a1c376654` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:24.566805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89add0392de0411d8623cc0a1c376654)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:24.571617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:24.714251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89add0392de0411d8623cc0a1c376654'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.714251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89add0392de0411d8623cc0a1c376654'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.714453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44325a-1999-4d58-a65d-7242296f242a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:24.722582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:24.723679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:24.724039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:24.724525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:24.727389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:24.728273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89add0392de0411d8623cc0a1c376654'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.737543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89add0392de0411d8623cc0a1c376654'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.738273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89add0392de0411d8623cc0a1c376654'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:24.750544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:24.753682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:24.762145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 966/1963] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:24 2022] DELETE /identity/v3/users/89add0392de0411d8623cc0a1c376654 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:24.763269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:24.774402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:24.781344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 998/1964] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:24.817943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:24.906902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b39e32-ac36-4ea9-b77d-b060d4a9220f admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:24.912629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:24.913683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:24.914016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:24.914773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] PATH_INFO: `/v3/projects/764026592dc04f3fb7e13ab247a92b2b` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:24.915633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=764026592dc04f3fb7e13ab247a92b2b)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:24.917959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.014304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764026592dc04f3fb7e13ab247a92b2b', 'request_id': 'req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.037217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764026592dc04f3fb7e13ab247a92b2b', 'request_id': 'req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.045665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764026592dc04f3fb7e13ab247a92b2b', 'request_id': 'req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.063884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] The token cache is being invalidate because project 764026592dc04f3fb7e13ab247a92b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:25.064279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.065371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.071605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 967/1965] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:24 2022] DELETE /identity/v3/projects/764026592dc04f3fb7e13ab247a92b2b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:25.075933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.088060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d547f-d2bc-47d7-9494-ee3c01862e1b service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.131103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:25.151797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.153576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.188789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.189760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.190123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.190515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] PATH_INFO: `/v3/users/09297744d09842a2b34c390156c240af` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.192227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09297744d09842a2b34c390156c240af)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:25.194605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.246519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484444fd-4fb0-49e5-a0ce-c2cb5aeeb92e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.253042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.254225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.254662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.254995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] PATH_INFO: `/v3/projects/8024fb8d59cb41979823c5ae048980ac` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.256427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8024fb8d59cb41979823c5ae048980ac)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:25.259401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.264969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09297744d09842a2b34c390156c240af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.273945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09297744d09842a2b34c390156c240af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.288233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09297744d09842a2b34c390156c240af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.289000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09297744d09842a2b34c390156c240af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.289631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09297744d09842a2b34c390156c240af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.306174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 999/1966] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:25 2022] DELETE /identity/v3/users/09297744d09842a2b34c390156c240af => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:25.306927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.308403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.331052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:25.334884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8024fb8d59cb41979823c5ae048980ac', 'request_id': 'req-7dfe3466-4db8-4b22-9327-f1bafcc67a99'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.349156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8024fb8d59cb41979823c5ae048980ac', 'request_id': 'req-7dfe3466-4db8-4b22-9327-f1bafcc67a99'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.358312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8024fb8d59cb41979823c5ae048980ac', 'request_id': 'req-7dfe3466-4db8-4b22-9327-f1bafcc67a99'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.371754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] The token cache is being invalidate because project 8024fb8d59cb41979823c5ae048980ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:25.372238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.373891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7dfe3466-4db8-4b22-9327-f1bafcc67a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.379673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 968/1967] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:25 2022] DELETE /identity/v3/projects/8024fb8d59cb41979823c5ae048980ac => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:25.381520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e6bb-2afa-4afa-80e5-28c69b4678a5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.381734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e6bb-2afa-4afa-80e5-28c69b4678a5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.382008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e6bb-2afa-4afa-80e5-28c69b4678a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.411870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-4528e6bb-2afa-4afa-80e5-28c69b4678a5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:25.414196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4528e6bb-2afa-4afa-80e5-28c69b4678a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.423569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a43ae-7aa3-4c9a-aa6b-03ca54dd3b19 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.430242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.431130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.431417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.431699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] PATH_INFO: `/v3/projects/3eea943a872546b98cf08ad5d0b016cc` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.433183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eea943a872546b98cf08ad5d0b016cc)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:25.435762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.444259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 969/1968] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:25.447941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf893d51-10d6-4aaf-96c7-d8901eb7a229 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.448237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf893d51-10d6-4aaf-96c7-d8901eb7a229 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.448520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf893d51-10d6-4aaf-96c7-d8901eb7a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.482951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-cf893d51-10d6-4aaf-96c7-d8901eb7a229 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:25.484373 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cf893d51-10d6-4aaf-96c7-d8901eb7a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.494171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 970/1969] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:25.498544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf893d51-10d6-4aaf-96c7-d8901eb7a229 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.512235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf893d51-10d6-4aaf-96c7-d8901eb7a229 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.514408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:25.520310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eea943a872546b98cf08ad5d0b016cc', 'request_id': 'req-a9015386-284d-4152-91ff-ce7f504c0c9b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.533956 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eea943a872546b98cf08ad5d0b016cc', 'request_id': 'req-a9015386-284d-4152-91ff-ce7f504c0c9b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.544889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eea943a872546b98cf08ad5d0b016cc', 'request_id': 'req-a9015386-284d-4152-91ff-ce7f504c0c9b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.558683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] The token cache is being invalidate because project 3eea943a872546b98cf08ad5d0b016cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:25.558984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.559824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a9015386-284d-4152-91ff-ce7f504c0c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:25.561808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1000/1970] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:25 2022] DELETE /identity/v3/projects/3eea943a872546b98cf08ad5d0b016cc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:25.567690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208083b-26b8-4740-b9cb-2dc3536bab9e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.567858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208083b-26b8-4740-b9cb-2dc3536bab9e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.568086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208083b-26b8-4740-b9cb-2dc3536bab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.609784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7208083b-26b8-4740-b9cb-2dc3536bab9e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:25.611995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7208083b-26b8-4740-b9cb-2dc3536bab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.671783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.672786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.672922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.674272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.675016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:25.675842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:25.680754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.730021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 971/1971] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:25.733848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.738022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.752490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1efc06-850e-47f0-8e1f-338ea13506c9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.758675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1001/1972] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:25.764788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.764788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.764788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.764788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.765097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:25.765097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.768015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.768491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.769065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.801840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 972/1973] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:25 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:25.807034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:25.808632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.810715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.915226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1002/1974] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:25.916296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.918391 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:25.934746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b658-dc22-4a52-a7ff-db227e55a779 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.941526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.941961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696ebe-8a3e-466d-b557-980037e1a585 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.942580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.942935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.943857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] PATH_INFO: `/v3/projects/a27a7816b4af453fb53844372303bb26` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.945416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27a7816b4af453fb53844372303bb26)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:25.947459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.947716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.948436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.948760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.949044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.949956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:25.952307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:25.979994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 973/1975] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:25 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:25.981164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:25.992408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae4d31-3842-4541-9b1f-7fdaa08e9487 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:25.997472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:25.998132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:25.998459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:25.998735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:25.999524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:25.999825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.001850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.017075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 974/1976] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:26.018181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.028824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27a7816b4af453fb53844372303bb26', 'request_id': 'req-95ade931-94ec-45fd-b53b-60d32f6dea9c'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:26.038351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27a7816b4af453fb53844372303bb26', 'request_id': 'req-95ade931-94ec-45fd-b53b-60d32f6dea9c'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:26.044532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b718d-2bab-45d0-8d98-60b59fb36334 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.049769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27a7816b4af453fb53844372303bb26', 'request_id': 'req-95ade931-94ec-45fd-b53b-60d32f6dea9c'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:26.053656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:26.058491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:26.067925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] The token cache is being invalidate because project a27a7816b4af453fb53844372303bb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:26.068751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:26.069447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:26.071537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1003/1977] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:25 2022] DELETE /identity/v3/projects/a27a7816b4af453fb53844372303bb26 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:26.073946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.088949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:26.145293 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab0b5b-c464-4761-a791-e76cda534ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.147060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab0b5b-c464-4761-a791-e76cda534ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.147624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab0b5b-c464-4761-a791-e76cda534ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.147849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab0b5b-c464-4761-a791-e76cda534ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.148786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab0b5b-c464-4761-a791-e76cda534ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.151055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab0b5b-c464-4761-a791-e76cda534ad7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.171598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 975/1978] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:26.176627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.176627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.176627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.202926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:26.204401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:26.215875 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 976/1979] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:26.217521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.218739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:26.231275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ade931-94ec-45fd-b53b-60d32f6dea9c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.235634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1027d-6f62-463b-8fc7-7c2657f91d23 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.238624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.239299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.239584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.239863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.241223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.244017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.246531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b1b53-e04b-43d8-affa-3603b4be7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.247215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b1b53-e04b-43d8-affa-3603b4be7ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.247526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b1b53-e04b-43d8-affa-3603b4be7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.247792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b1b53-e04b-43d8-affa-3603b4be7ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.248485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b1b53-e04b-43d8-affa-3603b4be7ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.250779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b1b53-e04b-43d8-affa-3603b4be7ff2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.263388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 977/1980] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:26.264128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d81d-ae60-462a-ae8f-b1c2aeb5fc71 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.264472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d81d-ae60-462a-ae8f-b1c2aeb5fc71 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.264889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d81d-ae60-462a-ae8f-b1c2aeb5fc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.276626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1004/1981] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:26.276811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.286671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ca47d81d-ae60-462a-ae8f-b1c2aeb5fc71 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:26.287908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ca47d81d-ae60-462a-ae8f-b1c2aeb5fc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:26.340997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbcc8e-b5ce-4d79-a6c4-8dc45542d558 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.345719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.346618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.346910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.347196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] PATH_INFO: `/v3/projects/702ae02b36984c138b6ff34b98252fd2/users/63d3de98f1f24b3385792356acf5e360/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.349570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 978/1982] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:26.350580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d81d-ae60-462a-ae8f-b1c2aeb5fc71 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.359942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d81d-ae60-462a-ae8f-b1c2aeb5fc71 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.362283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702ae02b36984c138b6ff34b98252fd2, user_id=63d3de98f1f24b3385792356acf5e360, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.364700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4364e9-25a8-429f-bcbd-d879045e877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.365584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.366283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4364e9-25a8-429f-bcbd-d879045e877b admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.366571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4364e9-25a8-429f-bcbd-d879045e877b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.366850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4364e9-25a8-429f-bcbd-d879045e877b admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.367532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4364e9-25a8-429f-bcbd-d879045e877b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.369466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4364e9-25a8-429f-bcbd-d879045e877b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.379442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1005/1983] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:26 2022] PUT /identity/v3/projects/702ae02b36984c138b6ff34b98252fd2/users/63d3de98f1f24b3385792356acf5e360/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:26.383046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.392899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 979/1984] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:26.394040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ab6e-a023-4725-930b-3ad80b499a91 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.394323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ab6e-a023-4725-930b-3ad80b499a91 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.394608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ab6e-a023-4725-930b-3ad80b499a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.419901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9eb9ab6e-a023-4725-930b-3ad80b499a91 None None] MFA Rules not processed for user `63d3de98f1f24b3385792356acf5e360`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:26.421141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9eb9ab6e-a023-4725-930b-3ad80b499a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:26.449722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fccb-b750-4eb2-bef6-994c0cdad5b4 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.454890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.455568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.455854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.456136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.456897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:26.457212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.458862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.466572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:26.478527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1006/1985] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:26.479403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.489566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb05f5-ad51-4fc0-bfd9-8cc83b6311e8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.493238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 980/1986] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:26.497039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ab6e-a023-4725-930b-3ad80b499a91 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.498931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.499711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.500074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.500430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.501301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:26.502079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.503754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.508887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ab6e-a023-4725-930b-3ad80b499a91 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.514611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.515279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.515563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.515840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.519467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1007/1987] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:26.519919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.520027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.520127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.520223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:26.548562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 981/1988] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:26.548562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.581371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0127d-7d25-411f-81dc-cdae3b48a1ee admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.612493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d5ea4-241e-420c-a736-851abb787f68 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.617896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.618563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.618844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.619125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.619847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.621479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.629731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.630380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.630694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.630978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.631453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 982/1989] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:26.632115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.641202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684536e-a669-4a48-9640-9dbb5a9acdde admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.646217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.646892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.647178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.647458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.648131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.650250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.672828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 983/1990] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:26.673625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.684665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae89c5-bcc7-4c36-ad41-8761e4099457 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.689275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fa6fe-2b2e-455c-9200-b2a5a5eb908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.690148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa6fe-2b2e-455c-9200-b2a5a5eb908f admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.690438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa6fe-2b2e-455c-9200-b2a5a5eb908f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.690718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa6fe-2b2e-455c-9200-b2a5a5eb908f admin admin] PATH_INFO: `/v3/projects/27f6eb98f1cc4a7d8f49b97c97676f4a/users/da2e599d1c6b44fe885de44c625a97bb/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.691484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.692957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.701835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1008/1991] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:26.702568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.705842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fa6fe-2b2e-455c-9200-b2a5a5eb908f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f6eb98f1cc4a7d8f49b97c97676f4a, user_id=da2e599d1c6b44fe885de44c625a97bb, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.708547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fa6fe-2b2e-455c-9200-b2a5a5eb908f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.712674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27558193-9f3f-4e12-8a2f-2ddbf85fccff service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.720356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.722359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.722670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.722954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.723736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.726198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.729923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 984/1992] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:26 2022] PUT /identity/v3/projects/27f6eb98f1cc4a7d8f49b97c97676f4a/users/da2e599d1c6b44fe885de44c625a97bb/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:26.741054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1009/1993] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:26.741838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc83b0-199d-49f7-91b8-2b6106cc81ef None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.741966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.742147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc83b0-199d-49f7-91b8-2b6106cc81ef None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.742551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc83b0-199d-49f7-91b8-2b6106cc81ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.756468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a221-6b2f-4644-b609-519f76febc0f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.782572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-29fc83b0-199d-49f7-91b8-2b6106cc81ef None None] MFA Rules not processed for user `da2e599d1c6b44fe885de44c625a97bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:26.784129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-29fc83b0-199d-49f7-91b8-2b6106cc81ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:26.813527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:26.843578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.845390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.845865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.846358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.847278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.849313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.867153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1010/1994] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:26.868402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.883646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e48641-ff63-4607-81ee-25e6cbc0fb0d admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.890657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5a4f-3c0e-4a47-b149-b4af2c3dcca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.892181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5a4f-3c0e-4a47-b149-b4af2c3dcca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.893084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5a4f-3c0e-4a47-b149-b4af2c3dcca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.893566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5a4f-3c0e-4a47-b149-b4af2c3dcca3 admin admin] PATH_INFO: `/v3/projects/7beb46284ca04a6ab4b3994f7eea5cb1/users/795b149bfc214a4099680ab03bdc4d12/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.902933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 985/1995] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:26.906717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc83b0-199d-49f7-91b8-2b6106cc81ef None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:26.922054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf5a4f-3c0e-4a47-b149-b4af2c3dcca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7beb46284ca04a6ab4b3994f7eea5cb1, user_id=795b149bfc214a4099680ab03bdc4d12, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.924729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc83b0-199d-49f7-91b8-2b6106cc81ef None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:26.930575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf5a4f-3c0e-4a47-b149-b4af2c3dcca3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.933745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:26.934590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.934908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.936721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.937486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:26.939441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:26.958230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1011/1996] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:26 2022] PUT /identity/v3/projects/7beb46284ca04a6ab4b3994f7eea5cb1/users/795b149bfc214a4099680ab03bdc4d12/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:26.960212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9f23-058c-46aa-8749-682302de3cd2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:26.960487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9f23-058c-46aa-8749-682302de3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:26.961284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9f23-058c-46aa-8749-682302de3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:26.993258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 986/1997] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:26.997287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.003323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:27.012539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f10a9f23-058c-46aa-8749-682302de3cd2 None None] MFA Rules not processed for user `795b149bfc214a4099680ab03bdc4d12`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:27.016318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f10a9f23-058c-46aa-8749-682302de3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:27.087827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42a8f-6e55-47b8-b4fc-306ddc47ae10 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.108000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.108759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.109102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.109384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.110684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.114457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.158887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 987/1998] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:27.164209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.168140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1012/1999] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:27.169187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9f23-058c-46aa-8749-682302de3cd2 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.189243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9f23-058c-46aa-8749-682302de3cd2 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.192457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9ed9b-df60-4cee-92c0-198bfd9a938c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.211558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.211736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.212113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.212403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.213397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.216509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.216736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.220186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.220853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.223431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.224229 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.227558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.245517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 988/2000] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:27.246855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.259330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74753b-c95b-4245-a0ab-bbc446df7a8e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.266489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.267621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.268042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.268406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] PATH_INFO: `/v3/projects/70db5e45dd704e16a6be86608d1c703d/users/237e2e5eec7b43b7b0b98deacf205dba/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.288021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70db5e45dd704e16a6be86608d1c703d, user_id=237e2e5eec7b43b7b0b98deacf205dba, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.290763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.310968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1013/2001] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:27 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:27.310968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.317354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 989/2002] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:27 2022] PUT /identity/v3/projects/70db5e45dd704e16a6be86608d1c703d/users/237e2e5eec7b43b7b0b98deacf205dba/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:27.321244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.392150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22880ba0-b5ed-4958-a02b-a9e175209622 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.398458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.399137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.399430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.399714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.400415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.402383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.405520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e59a07-3d5b-43e9-991f-978675232f86 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.410168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.410831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.411117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.411397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.412155 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.413931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.423747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1014/2003] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:27 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:27.427850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 990/2004] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:27.428025 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.428893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.437806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f4a3-a8ff-4a70-921d-8f79377f24bd admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.438502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee23a-7c5f-40ed-a742-f1ab835a2827 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.442440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.443087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.443700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4b52a-cd93-412f-969c-86cbc4d4f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.443902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.444202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.444544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b52a-cd93-412f-969c-86cbc4d4f137 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.444863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b52a-cd93-412f-969c-86cbc4d4f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.445040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.445133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b52a-cd93-412f-969c-86cbc4d4f137 admin admin] PATH_INFO: `/v3/projects/70db5e45dd704e16a6be86608d1c703d/users/237e2e5eec7b43b7b0b98deacf205dba/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.446631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.447125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4b52a-cd93-412f-969c-86cbc4d4f137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70db5e45dd704e16a6be86608d1c703d, user_id=237e2e5eec7b43b7b0b98deacf205dba, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.449820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4b52a-cd93-412f-969c-86cbc4d4f137 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.456634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1015/2005] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:27.461202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 991/2006] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:27 2022] PUT /identity/v3/projects/70db5e45dd704e16a6be86608d1c703d/users/237e2e5eec7b43b7b0b98deacf205dba/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:27.461328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.470808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:27.471031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ad85-3090-4adb-af01-78dd8f892f19 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.471447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ad85-3090-4adb-af01-78dd8f892f19 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.471562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ad85-3090-4adb-af01-78dd8f892f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.474540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be036-5fa3-4989-8425-c08d2c2b03bc admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.499336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5539ad85-3090-4adb-af01-78dd8f892f19 None None] MFA Rules not processed for user `237e2e5eec7b43b7b0b98deacf205dba`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:27.500554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5539ad85-3090-4adb-af01-78dd8f892f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:27.530153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:27.533372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.534555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.534817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.535128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] PATH_INFO: `/v3/projects/f9870fda85ef45288f0e100541acd9a8/users/d80fd221d84748d8951228e0ac2ae9af/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.550302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9870fda85ef45288f0e100541acd9a8, user_id=d80fd221d84748d8951228e0ac2ae9af, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.553095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.573230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1016/2007] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:27 2022] PUT /identity/v3/projects/f9870fda85ef45288f0e100541acd9a8/users/d80fd221d84748d8951228e0ac2ae9af/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:27.577635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.578664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 992/2008] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:27.590327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ad85-3090-4adb-af01-78dd8f892f19 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.639751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076249-3d61-48c8-b7da-a8690341cb48 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.644477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.645178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.645472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.645756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.647056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.647571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ad85-3090-4adb-af01-78dd8f892f19 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.648678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.659279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1017/2009] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:27.663308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.672839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fffcbf-5411-47fd-b779-e52329506370 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.678231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7f29-6adf-4e87-b16e-9a119af03b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.679104 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7f29-6adf-4e87-b16e-9a119af03b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.679388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7f29-6adf-4e87-b16e-9a119af03b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.679670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7f29-6adf-4e87-b16e-9a119af03b05 admin admin] PATH_INFO: `/v3/projects/f9870fda85ef45288f0e100541acd9a8/users/d80fd221d84748d8951228e0ac2ae9af/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.681708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7f29-6adf-4e87-b16e-9a119af03b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9870fda85ef45288f0e100541acd9a8, user_id=d80fd221d84748d8951228e0ac2ae9af, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.684383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7f29-6adf-4e87-b16e-9a119af03b05 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.695824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1018/2010] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:27 2022] PUT /identity/v3/projects/f9870fda85ef45288f0e100541acd9a8/users/d80fd221d84748d8951228e0ac2ae9af/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:27.698484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.699144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.699433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.699830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.706290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c35c-a52c-4070-a860-a1d92ea91eb7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.706591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c35c-a52c-4070-a860-a1d92ea91eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.706881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c35c-a52c-4070-a860-a1d92ea91eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.734100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-08c4c35c-a52c-4070-a860-a1d92ea91eb7 None None] MFA Rules not processed for user `d80fd221d84748d8951228e0ac2ae9af`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:27.735237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-08c4c35c-a52c-4070-a860-a1d92ea91eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:27.758070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.760018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.769495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 993/2011] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:27.794920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:27.809491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1019/2012] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:27.817047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:27.819134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:27.830167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beede0-4eff-4f9b-be68-3e1e58c34bb5 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:27.863601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:27.886378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:27.887055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:27.887340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:27.887623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:27.898826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:27.900300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:27.912723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 994/2013] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:28.006678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4c35c-a52c-4070-a860-a1d92ea91eb7 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:28.018329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4c35c-a52c-4070-a860-a1d92ea91eb7 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:28.023011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750574bb-25a7-4262-9bde-8317aa8f0395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:28.023967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750574bb-25a7-4262-9bde-8317aa8f0395 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:28.024365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750574bb-25a7-4262-9bde-8317aa8f0395 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:28.024853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750574bb-25a7-4262-9bde-8317aa8f0395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:28.100033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750574bb-25a7-4262-9bde-8317aa8f0395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:28.101395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750574bb-25a7-4262-9bde-8317aa8f0395 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:28.111226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1020/2014] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:37.906634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=10 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:38.106608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=30 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:41.938921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:42.012747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3ffa-c7cc-463d-a21a-bc8dcf31b879 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:42.012747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:42.013411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:42.013718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:42.014007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] PATH_INFO: `/v3/users/795b149bfc214a4099680ab03bdc4d12` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:42.015685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795b149bfc214a4099680ab03bdc4d12)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:42.017957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:42.080209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795b149bfc214a4099680ab03bdc4d12'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.080900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795b149bfc214a4099680ab03bdc4d12'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.094922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795b149bfc214a4099680ab03bdc4d12'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.105827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795b149bfc214a4099680ab03bdc4d12'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.106567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795b149bfc214a4099680ab03bdc4d12'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.121129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 995/2015] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:41 2022] DELETE /identity/v3/users/795b149bfc214a4099680ab03bdc4d12 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:42.125834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:42.126308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:42.126401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:42.144032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:42.145320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:42.216489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1021/2016] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:42.228671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:42.230244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:42.292560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54aecf-b713-4680-b421-948768ef0c78 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:42.296664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:42.297320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:42.297607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:42.297972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:42.309027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:42.310521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:42.321233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 996/2017] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:42.649234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:42.651631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:42.672285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff8373-c237-4084-9c92-7818625dad6f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:42.679530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:42.679920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:42.680787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:42.681174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:42.681553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] PATH_INFO: `/v3/projects/7beb46284ca04a6ab4b3994f7eea5cb1` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:42.682069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:42.683140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7beb46284ca04a6ab4b3994f7eea5cb1)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:42.685506 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:42.732861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:42.765493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7beb46284ca04a6ab4b3994f7eea5cb1', 'request_id': 'req-05d4987a-ec86-4abc-8da8-324d8824178b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.773129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7beb46284ca04a6ab4b3994f7eea5cb1', 'request_id': 'req-05d4987a-ec86-4abc-8da8-324d8824178b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.784802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7beb46284ca04a6ab4b3994f7eea5cb1', 'request_id': 'req-05d4987a-ec86-4abc-8da8-324d8824178b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.794313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549a814-ae4a-4260-bdd6-2b00977b2a7d service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:42.805267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] The token cache is being invalidate because project 7beb46284ca04a6ab4b3994f7eea5cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:42.806442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.808166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:42.810498 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1022/2018] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:42 2022] DELETE /identity/v3/projects/7beb46284ca04a6ab4b3994f7eea5cb1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:42.814674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:42.816547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:42.867060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:42.867724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:42.868015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:42.868442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:42.870339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:42.907350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4987a-ec86-4abc-8da8-324d8824178b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:42.915669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:42.917026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:42.917406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:42.917834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] PATH_INFO: `/v3/users/d80fd221d84748d8951228e0ac2ae9af` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:42.919427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80fd221d84748d8951228e0ac2ae9af)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:42.922492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:42.962212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:42.968210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:42.970100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:42.991201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 997/2019] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:43.002586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80fd221d84748d8951228e0ac2ae9af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.014287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80fd221d84748d8951228e0ac2ae9af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.033288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:43.034825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.047722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80fd221d84748d8951228e0ac2ae9af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.049711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80fd221d84748d8951228e0ac2ae9af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.050642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0b7cc83d-b664-45f8-a32e-f635796d5353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80fd221d84748d8951228e0ac2ae9af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.056718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abd675-1039-4ee8-8041-d1a381e3bb5a service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:43.064803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:43.065078 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.065427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.065847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] PATH_INFO: `/v3/users/63d3de98f1f24b3385792356acf5e360` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.071192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d3de98f1f24b3385792356acf5e360)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:43.074518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:43.075569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1023/2020] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:42 2022] DELETE /identity/v3/users/d80fd221d84748d8951228e0ac2ae9af => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:43.152551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d3de98f1f24b3385792356acf5e360'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.153390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d3de98f1f24b3385792356acf5e360'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.173858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d3de98f1f24b3385792356acf5e360'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.185600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d3de98f1f24b3385792356acf5e360'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.186385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d3de98f1f24b3385792356acf5e360'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.216969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:43.232481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 998/2021] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:43 2022] DELETE /identity/v3/users/63d3de98f1f24b3385792356acf5e360 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:43.236960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.237424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.237508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.266726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:43.267957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.389152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1024/2022] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:43.405336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:43.409749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.497925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c69982-0636-4199-8512-2441f9d8ef88 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:43.501857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6c638-3ca5-4e0c-9337-f2f23d5458cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:43.503444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6c638-3ca5-4e0c-9337-f2f23d5458cf service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.503444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6c638-3ca5-4e0c-9337-f2f23d5458cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.503444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6c638-3ca5-4e0c-9337-f2f23d5458cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.521737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6c638-3ca5-4e0c-9337-f2f23d5458cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:43.524253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6c638-3ca5-4e0c-9337-f2f23d5458cf service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:43.549075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:43.553599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.568972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 999/2023] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:43.583856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e468b-5442-4ff7-b854-2279fd45a82d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:43.604416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:43.604416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.604416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.604416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] PATH_INFO: `/v3/projects/f9870fda85ef45288f0e100541acd9a8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.605479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9870fda85ef45288f0e100541acd9a8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:43.609645 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:43.690185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9870fda85ef45288f0e100541acd9a8', 'request_id': 'req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.698153 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9870fda85ef45288f0e100541acd9a8', 'request_id': 'req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.710084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9870fda85ef45288f0e100541acd9a8', 'request_id': 'req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.723905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] The token cache is being invalidate because project f9870fda85ef45288f0e100541acd9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:43.724129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.725035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.727806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1025/2024] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:43 2022] DELETE /identity/v3/projects/f9870fda85ef45288f0e100541acd9a8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:43.733530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacf2d2-e171-442c-8a09-48aadc3788aa None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.733844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacf2d2-e171-442c-8a09-48aadc3788aa None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.734206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacf2d2-e171-442c-8a09-48aadc3788aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.753804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2eacf2d2-e171-442c-8a09-48aadc3788aa None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:43.755093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2eacf2d2-e171-442c-8a09-48aadc3788aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.822150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:43.823618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.842884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1000/2025] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:43.851796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdea9-efcc-4ad2-8817-2f3c4b7e632b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.852027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdea9-efcc-4ad2-8817-2f3c4b7e632b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.852340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdea9-efcc-4ad2-8817-2f3c4b7e632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.863699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:43.872274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-245bdea9-efcc-4ad2-8817-2f3c4b7e632b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:43.873571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-245bdea9-efcc-4ad2-8817-2f3c4b7e632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.882770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1001/2026] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:43.887091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdea9-efcc-4ad2-8817-2f3c4b7e632b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:43.896376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdea9-efcc-4ad2-8817-2f3c4b7e632b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:43.902237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:43.902926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.903452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.903582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.904741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:43.904741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:43.907475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865a4f7-8dd1-4bc9-bf1c-8585b10f7a9d admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:43.907609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:43.911565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:43.912642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.912933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.913214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] PATH_INFO: `/v3/users/b21d00320f764fd98e4c22c46b4808f2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.914582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21d00320f764fd98e4c22c46b4808f2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:43.916596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:43.919972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1002/2027] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:56:43.924272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:43.935175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737b0d-24f2-446f-adb6-d9450e550d66 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:43.941148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:43.941814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:43.942158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:43.942371 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:43.945430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:43.948374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:43.976571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21d00320f764fd98e4c22c46b4808f2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:43.977586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1003/2028] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:43 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:43.978455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:43.980005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:43.987821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21d00320f764fd98e4c22c46b4808f2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.005778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21d00320f764fd98e4c22c46b4808f2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.007002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21d00320f764fd98e4c22c46b4808f2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.008014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21d00320f764fd98e4c22c46b4808f2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.020917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1026/2029] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:43 2022] DELETE /identity/v3/users/b21d00320f764fd98e4c22c46b4808f2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:44.021794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.024016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.058528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854248f-42cb-44fa-8c8c-c318419926c0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.064024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:44.102871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebb42-fd44-45f2-8cf6-524f4625f6e9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.107665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86179f5-5a8a-48ad-91ec-eb8cd3395b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.108180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86179f5-5a8a-48ad-91ec-eb8cd3395b02 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.108473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86179f5-5a8a-48ad-91ec-eb8cd3395b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.108796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86179f5-5a8a-48ad-91ec-eb8cd3395b02 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.109489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86179f5-5a8a-48ad-91ec-eb8cd3395b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.111414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86179f5-5a8a-48ad-91ec-eb8cd3395b02 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.121447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.122412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.122815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.123176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] PATH_INFO: `/v3/projects/702ae02b36984c138b6ff34b98252fd2` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.124674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702ae02b36984c138b6ff34b98252fd2)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.126940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.132006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1027/2030] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:44.133545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44986f16-a67c-41cd-89f1-df92fca685da None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.133841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44986f16-a67c-41cd-89f1-df92fca685da None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.134127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44986f16-a67c-41cd-89f1-df92fca685da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.155538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-44986f16-a67c-41cd-89f1-df92fca685da None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:44.156875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-44986f16-a67c-41cd-89f1-df92fca685da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.165930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1028/2031] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:44.167107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44986f16-a67c-41cd-89f1-df92fca685da None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.177277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44986f16-a67c-41cd-89f1-df92fca685da None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.187616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702ae02b36984c138b6ff34b98252fd2', 'request_id': 'req-8f242cb7-f70e-4baf-826a-2f0e6d13a213'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.197941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702ae02b36984c138b6ff34b98252fd2', 'request_id': 'req-8f242cb7-f70e-4baf-826a-2f0e6d13a213'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.204223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702ae02b36984c138b6ff34b98252fd2', 'request_id': 'req-8f242cb7-f70e-4baf-826a-2f0e6d13a213'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.207719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:44.221026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] The token cache is being invalidate because project 702ae02b36984c138b6ff34b98252fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:44.221349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.222038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.223828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1004/2032] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:43 2022] DELETE /identity/v3/projects/702ae02b36984c138b6ff34b98252fd2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:44.224367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.226325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.246463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35454-0cbc-4d53-9ca9-fa0f995c04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.247733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35454-0cbc-4d53-9ca9-fa0f995c04c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.248019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35454-0cbc-4d53-9ca9-fa0f995c04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.248301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35454-0cbc-4d53-9ca9-fa0f995c04c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.249087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac35454-0cbc-4d53-9ca9-fa0f995c04c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.250686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac35454-0cbc-4d53-9ca9-fa0f995c04c6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.260463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1029/2033] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:44.261815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.262125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.262395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.280384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:44.281609 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.283396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f242cb7-f70e-4baf-826a-2f0e6d13a213 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.287252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84947-64ee-4077-92c1-e022bb2d2908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.288470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84947-64ee-4077-92c1-e022bb2d2908 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.288778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84947-64ee-4077-92c1-e022bb2d2908 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.289049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84947-64ee-4077-92c1-e022bb2d2908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.290138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1030/2034] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:44.290981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.292207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.296951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-53d84947-64ee-4077-92c1-e022bb2d2908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.303832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767e4e-efbd-464a-8269-35669c346a2a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.308879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.309544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.309661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84947-64ee-4077-92c1-e022bb2d2908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.309953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.310245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.310985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.311114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84947-64ee-4077-92c1-e022bb2d2908 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.312571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.321174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1005/2035] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:44.322758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d21ee1-77a8-488d-9957-5e01fa26987a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.322882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1031/2036] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:44.323060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d21ee1-77a8-488d-9957-5e01fa26987a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.324912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d21ee1-77a8-488d-9957-5e01fa26987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.327082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.337643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e90fcd-0ae8-4fe3-a2d7-31c15bb31488 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.342487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbf267-d823-4f60-b1ba-af4cb67d00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.343441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbf267-d823-4f60-b1ba-af4cb67d00e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.343742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbf267-d823-4f60-b1ba-af4cb67d00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.344032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbf267-d823-4f60-b1ba-af4cb67d00e7 admin admin] PATH_INFO: `/v3/projects/aa47aeea058d4846a17e07d8d116984a/users/03d917013dd04146a3f7604b4856d63e/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.344645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d0d21ee1-77a8-488d-9957-5e01fa26987a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:44.345843 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d0d21ee1-77a8-488d-9957-5e01fa26987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.356092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1006/2037] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:44.360416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d21ee1-77a8-488d-9957-5e01fa26987a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.364197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbf267-d823-4f60-b1ba-af4cb67d00e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa47aeea058d4846a17e07d8d116984a, user_id=03d917013dd04146a3f7604b4856d63e, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.366694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbf267-d823-4f60-b1ba-af4cb67d00e7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.370260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d21ee1-77a8-488d-9957-5e01fa26987a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.376507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.377292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.377606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.378114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.379318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:44.379438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.381149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.384764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1032/2038] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:44 2022] PUT /identity/v3/projects/aa47aeea058d4846a17e07d8d116984a/users/03d917013dd04146a3f7604b4856d63e/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:44.394774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1007/2039] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:44.395475 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.395992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.396408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.399286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.411443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50492511-35db-4bbe-bedb-f08200d747a0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.428848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] MFA Rules not processed for user `03d917013dd04146a3f7604b4856d63e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:44.430324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.435282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:44.493037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.494192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.494660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.494938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.495637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.498377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.515346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1033/2040] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:44.526440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.528630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.546822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1008/2041] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:44.551116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.603592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7825a7-7052-4111-a348-8ef9a7220b9c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.641766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:44.668371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.669470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.669907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.670474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.686072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3d279-3d1f-41e3-846c-9fc738ce4efc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.692328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.692957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.693572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.695956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.695956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.697405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.722842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1009/2042] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:44.723775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.726046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.744698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b807fd-0d92-4de6-a919-56a5213b1ab9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.749802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.750734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.751189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.751964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.752089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.752458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] PATH_INFO: `/v3/projects/baa191cea5ac42908b39dc6b84748148` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.753835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa191cea5ac42908b39dc6b84748148)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.755842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.762584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1034/2043] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:44.763672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.775844 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ee38-3640-4a8f-93b3-9a5b58c20884 service glance] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.780694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.781432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.782071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.782071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.782621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.784474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.799552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1035/2044] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:44.810585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.826399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa191cea5ac42908b39dc6b84748148', 'request_id': 'req-e7858de0-e47a-433a-b109-886296b96996'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.826512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64981771-22a2-4a0a-b438-8044e72f1180 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.831380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa191cea5ac42908b39dc6b84748148', 'request_id': 'req-e7858de0-e47a-433a-b109-886296b96996'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.837915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa191cea5ac42908b39dc6b84748148', 'request_id': 'req-e7858de0-e47a-433a-b109-886296b96996'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.853336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] The token cache is being invalidate because project baa191cea5ac42908b39dc6b84748148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:44.853891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.854731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:44.856224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1010/2045] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:44 2022] DELETE /identity/v3/projects/baa191cea5ac42908b39dc6b84748148 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:44.859842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.861217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.885671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:44.888982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.889876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.890084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.890481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.891220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.892887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.905327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1036/2046] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:44.909607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:44.911596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:44.926389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7721712-749c-4af7-9ebe-bc6c404da7d6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.932400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8134d43-4924-4ab3-9af5-b0d3e22c2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.933454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134d43-4924-4ab3-9af5-b0d3e22c2bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.933747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134d43-4924-4ab3-9af5-b0d3e22c2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.934030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134d43-4924-4ab3-9af5-b0d3e22c2bdd admin admin] PATH_INFO: `/v3/projects/c948a4e90dd245bc9e4eae0aaa484997/users/98faa0823a9248719e32f7f71a15be7b/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.940295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7858de0-e47a-433a-b109-886296b96996 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:44.947841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:44.948778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.949094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.949375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] PATH_INFO: `/v3/users/66e5f540102f4959a26447c56e65e4b7` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:44.950599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e5f540102f4959a26447c56e65e4b7)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.951713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8134d43-4924-4ab3-9af5-b0d3e22c2bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c948a4e90dd245bc9e4eae0aaa484997, user_id=98faa0823a9248719e32f7f71a15be7b, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:44.952553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.954816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8134d43-4924-4ab3-9af5-b0d3e22c2bdd admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:44.971237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1037/2047] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:44 2022] PUT /identity/v3/projects/c948a4e90dd245bc9e4eae0aaa484997/users/98faa0823a9248719e32f7f71a15be7b/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:44.983014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594436b-770c-40d0-8e76-db45d46f816b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:44.983315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594436b-770c-40d0-8e76-db45d46f816b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:44.983605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594436b-770c-40d0-8e76-db45d46f816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.013334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-2594436b-770c-40d0-8e76-db45d46f816b None None] MFA Rules not processed for user `98faa0823a9248719e32f7f71a15be7b`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:45.015802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2594436b-770c-40d0-8e76-db45d46f816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:45.016381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e5f540102f4959a26447c56e65e4b7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.017362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e5f540102f4959a26447c56e65e4b7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.031696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e5f540102f4959a26447c56e65e4b7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.038903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e5f540102f4959a26447c56e65e4b7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.039692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e5f540102f4959a26447c56e65e4b7'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.052281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:45.057442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1011/2048] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:44 2022] DELETE /identity/v3/users/66e5f540102f4959a26447c56e65e4b7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:45.094133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1038/2049] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:45.098656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.100622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:45.195579 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fa11e-479e-415a-9a5d-8506eb24ddb5 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.200708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.201729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.202350 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.202631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.203375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.205382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.266407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1012/2050] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:45.267642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594436b-770c-40d0-8e76-db45d46f816b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.354695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594436b-770c-40d0-8e76-db45d46f816b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.398722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.400774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:45.431887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.432557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.433262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.433547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.434249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.434617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:45.436573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.457179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1039/2051] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:45.461448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.471125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d463fa-1bcd-4241-b862-d2cf1d338460 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.476450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.477118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.477392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e39cb2-c55e-4b4d-9413-ad618f70dd40 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.477495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.477687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.478406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.480026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.482430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.483448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.483734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.484037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] PATH_INFO: `/v3/projects/5525b7d3b9ee4f72add465641978a29f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.485252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5525b7d3b9ee4f72add465641978a29f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.487161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.490377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1040/2052] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:45.494810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.505187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8980a-fd35-4070-b233-3d95821b4620 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.509912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.510557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.510847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.511129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.511975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.513605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.525143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1041/2053] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:45.528857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.538868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1bd78-3fd4-45df-a385-9ed99885ed26 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.539893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5525b7d3b9ee4f72add465641978a29f', 'request_id': 'req-be84a2b4-478f-4c27-8f9c-7549068717c8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.549027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5525b7d3b9ee4f72add465641978a29f', 'request_id': 'req-be84a2b4-478f-4c27-8f9c-7549068717c8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.555973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5525b7d3b9ee4f72add465641978a29f', 'request_id': 'req-be84a2b4-478f-4c27-8f9c-7549068717c8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.567252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] The token cache is being invalidate because project 5525b7d3b9ee4f72add465641978a29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:45.567552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.568208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be84a2b4-478f-4c27-8f9c-7549068717c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:45.569982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1013/2054] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:45 2022] DELETE /identity/v3/projects/5525b7d3b9ee4f72add465641978a29f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:45.574441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd9a5-25df-4b73-9d21-3b37ec115de7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.574737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd9a5-25df-4b73-9d21-3b37ec115de7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.575029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd9a5-25df-4b73-9d21-3b37ec115de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.586958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:45.593124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c9dcd9a5-25df-4b73-9d21-3b37ec115de7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:45.594362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c9dcd9a5-25df-4b73-9d21-3b37ec115de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:45.602122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3872e1e-baf5-49ee-8aca-da7df64bfcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.603378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3872e1e-baf5-49ee-8aca-da7df64bfcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.603829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3872e1e-baf5-49ee-8aca-da7df64bfcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.604249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3872e1e-baf5-49ee-8aca-da7df64bfcf2 admin admin] PATH_INFO: `/v3/projects/d3f70c2ac18d458dac20ca9223f0ba23/users/95d35808342943ea963bf61597663c1a/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.621622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3872e1e-baf5-49ee-8aca-da7df64bfcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f70c2ac18d458dac20ca9223f0ba23, user_id=95d35808342943ea963bf61597663c1a, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.624366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3872e1e-baf5-49ee-8aca-da7df64bfcf2 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.639834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1042/2055] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:45 2022] PUT /identity/v3/projects/d3f70c2ac18d458dac20ca9223f0ba23/users/95d35808342943ea963bf61597663c1a/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:45.649771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.650069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.650359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.661110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1014/2056] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:45.669257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e1e9a-4d7e-4d2d-ad38-081684f555aa None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.669549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e1e9a-4d7e-4d2d-ad38-081684f555aa None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.669824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e1e9a-4d7e-4d2d-ad38-081684f555aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.677115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] MFA Rules not processed for user `95d35808342943ea963bf61597663c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:45.678944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:45.688295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-3c7e1e9a-4d7e-4d2d-ad38-081684f555aa None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:45.689489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-3c7e1e9a-4d7e-4d2d-ad38-081684f555aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:45.747709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1043/2057] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:45.749787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:45.753107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.754697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:45.765101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1015/2058] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:45.769017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e1e9a-4d7e-4d2d-ad38-081684f555aa None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.773601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9440c94-2c27-4f3d-a807-e88a571d831e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.778021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e1e9a-4d7e-4d2d-ad38-081684f555aa None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.778331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.778990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.779286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.779567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.780271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.782299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.782531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.783174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.783462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.783742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.784460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:45.784807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.786411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.797944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1016/2059] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:56:45.802391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.809307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1044/2060] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:45.812637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80324d-5e8e-41a8-b357-e5edab91e849 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.814344 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.873548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.874347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.874695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.875043 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.875809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.877830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.882085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25a39-ef91-4854-92a5-b74a20ed1821 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.886980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.887732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.888090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.890205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.890205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.891289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:45.906660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1017/2061] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:45.910732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.916616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1045/2062] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:45.918124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:45.929267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308ae6-540a-4204-b5ed-6f5bce6ca09c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.962850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:45.982310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7f9e-4d20-4a3a-a56f-589c07902b66 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:45.987860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:45.988540 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:45.988891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:45.989135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:45.990123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:45.993327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.000008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.000697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.000982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.001263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.002003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.003705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.017654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1046/2063] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:46.017820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1018/2064] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:45 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:46.019694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.020047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.031233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606806d-62fc-4e1c-93fc-a81d48e637ce admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.031380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c00f-e65f-4cab-baa7-cf994b0339ce admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.035820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.036052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.036504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.036808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.036960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.037098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.037254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.038071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] PATH_INFO: `/v3/projects/641c36aa2b534f489d63a54dea300d12/users/b252b95ad1f044e99676a93feec882ba/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.038364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.039972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.050227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1019/2065] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:46.054152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641c36aa2b534f489d63a54dea300d12, user_id=b252b95ad1f044e99676a93feec882ba, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.054639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.056869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.064347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b597177-128b-4f45-87a5-bb2b95e48519 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.070274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.070976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.071256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.071535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.072123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1047/2066] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:46 2022] PUT /identity/v3/projects/641c36aa2b534f489d63a54dea300d12/users/b252b95ad1f044e99676a93feec882ba/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:46.072261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.073909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.076195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.087980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1020/2067] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:46.089245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.098758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86201bb1-40f8-4c96-a907-1fc5989c49d0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.135641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:46.141156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7247824-58ac-463e-bcec-e81a7f905df3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.147555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.148369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.148685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.148963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.149691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.151365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.161562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1048/2068] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:46.166431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0e15-8d8b-4f2f-b395-ad66c40c310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.167339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0e15-8d8b-4f2f-b395-ad66c40c310d admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.167628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0e15-8d8b-4f2f-b395-ad66c40c310d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.167912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0e15-8d8b-4f2f-b395-ad66c40c310d admin admin] PATH_INFO: `/v3/projects/23ab76c9c3c64c859088554ba41ee87f/users/1e6a0a13c0eb4a3ca8ee90d2f21fa69e/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.171086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.181602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eca74-6036-4918-93f3-594114c752c1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.185331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0e15-8d8b-4f2f-b395-ad66c40c310d admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ab76c9c3c64c859088554ba41ee87f, user_id=1e6a0a13c0eb4a3ca8ee90d2f21fa69e, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.186319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acfc43-5230-41b2-b0c7-1860eda3d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.187195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acfc43-5230-41b2-b0c7-1860eda3d1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.187480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acfc43-5230-41b2-b0c7-1860eda3d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.187758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acfc43-5230-41b2-b0c7-1860eda3d1e3 admin admin] PATH_INFO: `/v3/projects/641c36aa2b534f489d63a54dea300d12/users/b252b95ad1f044e99676a93feec882ba/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.188414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0e15-8d8b-4f2f-b395-ad66c40c310d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.196019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acfc43-5230-41b2-b0c7-1860eda3d1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641c36aa2b534f489d63a54dea300d12, user_id=b252b95ad1f044e99676a93feec882ba, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.199013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acfc43-5230-41b2-b0c7-1860eda3d1e3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.202981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1021/2069] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:46 2022] PUT /identity/v3/projects/23ab76c9c3c64c859088554ba41ee87f/users/1e6a0a13c0eb4a3ca8ee90d2f21fa69e/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:46.212154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1049/2070] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:46 2022] PUT /identity/v3/projects/641c36aa2b534f489d63a54dea300d12/users/b252b95ad1f044e99676a93feec882ba/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:46.214126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea84c0b-c0b0-425d-b010-9f5755dce10e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.214126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea84c0b-c0b0-425d-b010-9f5755dce10e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.214418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea84c0b-c0b0-425d-b010-9f5755dce10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.223134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354261-4162-4b19-9707-6d9aea332516 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.223427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354261-4162-4b19-9707-6d9aea332516 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.223706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354261-4162-4b19-9707-6d9aea332516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.241949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-cea84c0b-c0b0-425d-b010-9f5755dce10e None None] MFA Rules not processed for user `1e6a0a13c0eb4a3ca8ee90d2f21fa69e`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:46.243160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cea84c0b-c0b0-425d-b010-9f5755dce10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:46.251095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-78354261-4162-4b19-9707-6d9aea332516 None None] MFA Rules not processed for user `b252b95ad1f044e99676a93feec882ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:46.252269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-78354261-4162-4b19-9707-6d9aea332516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:46.310722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1022/2071] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:46.313873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea84c0b-c0b0-425d-b010-9f5755dce10e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.329232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1050/2072] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:46.343349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78354261-4162-4b19-9707-6d9aea332516 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.345469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-78354261-4162-4b19-9707-6d9aea332516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:46.358839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:46.389480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea84c0b-c0b0-425d-b010-9f5755dce10e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.394245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.394910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.395189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.395468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.396155 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.398995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.409038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78354261-4162-4b19-9707-6d9aea332516 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.413050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.413689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.414314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.414682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.416794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:46.424902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1023/2073] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:46 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:46.429075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.463251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:46.477808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.479257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.488470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1051/2074] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:46.493652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0277bc-4ae9-41f9-91a0-b37071d832b4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.498557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.499244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.499565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.499844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.500543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.502513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.526127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1024/2075] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:46 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:46.530100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.540866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a776d6-27b4-4bbd-9a78-e7cac24a16ca service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.545421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.546081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.546369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.546651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.547372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.549028 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.562702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1052/2076] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:46.564067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.575132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b23e0-a5a7-4f21-a622-19e1f72e13d9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.580567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.581707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.582148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.582436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] PATH_INFO: `/v3/projects/c2c25d9af53840e1bb139bb1714ad9f3/users/0696571137224c288aacd23e9c5460ba/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.597758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c25d9af53840e1bb139bb1714ad9f3, user_id=0696571137224c288aacd23e9c5460ba, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.600697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.614113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1025/2077] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:46 2022] PUT /identity/v3/projects/c2c25d9af53840e1bb139bb1714ad9f3/users/0696571137224c288aacd23e9c5460ba/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:46.618611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.633657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7085bd-b46a-4ec2-8f1b-a104724e0883 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.726608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533edb7-11d0-404e-af16-b567fe937c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.727402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533edb7-11d0-404e-af16-b567fe937c75 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.727770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533edb7-11d0-404e-af16-b567fe937c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.728130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533edb7-11d0-404e-af16-b567fe937c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.729023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533edb7-11d0-404e-af16-b567fe937c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.733297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533edb7-11d0-404e-af16-b567fe937c75 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.752547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1053/2078] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:46.753869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:46.764884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9505f-f463-43ea-87d9-060636e1da97 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:46.770777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:46.771943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.772263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.781848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] PATH_INFO: `/v3/projects/c2c25d9af53840e1bb139bb1714ad9f3/users/0696571137224c288aacd23e9c5460ba/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.784446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c25d9af53840e1bb139bb1714ad9f3, user_id=0696571137224c288aacd23e9c5460ba, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:46.787227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:46.804629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1026/2079] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:46 2022] PUT /identity/v3/projects/c2c25d9af53840e1bb139bb1714ad9f3/users/0696571137224c288aacd23e9c5460ba/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:46.812217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab153-5b6c-4a7e-902a-0eb8e5655415 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:46.812516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab153-5b6c-4a7e-902a-0eb8e5655415 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:46.812932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab153-5b6c-4a7e-902a-0eb8e5655415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:46.855334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1f3ab153-5b6c-4a7e-902a-0eb8e5655415 None None] MFA Rules not processed for user `0696571137224c288aacd23e9c5460ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:46.856561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1f3ab153-5b6c-4a7e-902a-0eb8e5655415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:46.902209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:46.934612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1054/2080] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:46.946270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:47.006512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91fc06-ecd0-4f3b-92a4-794561e961cd admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:47.017770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e655a-05c5-49fd-9bf2-15dd2ba9d79e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:47.017770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e655a-05c5-49fd-9bf2-15dd2ba9d79e service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:47.017770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e655a-05c5-49fd-9bf2-15dd2ba9d79e service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:47.017770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e655a-05c5-49fd-9bf2-15dd2ba9d79e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:47.024433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e655a-05c5-49fd-9bf2-15dd2ba9d79e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:47.025919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e655a-05c5-49fd-9bf2-15dd2ba9d79e service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:47.036606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1027/2081] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:47.444102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab153-5b6c-4a7e-902a-0eb8e5655415 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:47.506736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab153-5b6c-4a7e-902a-0eb8e5655415 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:47.511655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:47.512528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:47.512845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:47.513130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] PATH_INFO: `/v3/users/1e6a0a13c0eb4a3ca8ee90d2f21fa69e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:47.514471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6a0a13c0eb4a3ca8ee90d2f21fa69e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:47.517037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:47.566338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6a0a13c0eb4a3ca8ee90d2f21fa69e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:47.577731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6a0a13c0eb4a3ca8ee90d2f21fa69e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:47.592615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6a0a13c0eb4a3ca8ee90d2f21fa69e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:47.593407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6a0a13c0eb4a3ca8ee90d2f21fa69e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:47.594056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6a0a13c0eb4a3ca8ee90d2f21fa69e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:47.608550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1055/2082] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:47 2022] DELETE /identity/v3/users/1e6a0a13c0eb4a3ca8ee90d2f21fa69e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:47.613158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:47.613452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:47.613737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:47.630965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:47.632690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:47.689991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1028/2083] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:47.699933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:47.701434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:47.759466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9229a-0550-4cf3-a683-64f7c9a736d2 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:47.763215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:47.763948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:47.764176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:47.764459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:47.771599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:47.774920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:47.776895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:47.788291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1056/2084] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:48.109564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:48.112240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:48.136618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83093aaf-9ef7-44ad-b6fe-1de43450495c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:48.141339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:48.141803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:48.142655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:48.142938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:48.143031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:48.143217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] PATH_INFO: `/v3/projects/23ab76c9c3c64c859088554ba41ee87f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:48.144434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ab76c9c3c64c859088554ba41ee87f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:48.146367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:48.178809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:48.206060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ab76c9c3c64c859088554ba41ee87f', 'request_id': 'req-67229b8d-b5a8-435c-ad58-446b9a232a3b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.215427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3fc5-8c7d-4f64-b924-b20ed1760b3e service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:48.219412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ab76c9c3c64c859088554ba41ee87f', 'request_id': 'req-67229b8d-b5a8-435c-ad58-446b9a232a3b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.227212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ab76c9c3c64c859088554ba41ee87f', 'request_id': 'req-67229b8d-b5a8-435c-ad58-446b9a232a3b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.239420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] The token cache is being invalidate because project 23ab76c9c3c64c859088554ba41ee87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:48.239771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.240465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.242830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1029/2085] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:48 2022] DELETE /identity/v3/projects/23ab76c9c3c64c859088554ba41ee87f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:48.246596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:48.248036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:48.272214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:48.272987 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:48.273338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:48.273688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:48.275644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:48.315741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67229b8d-b5a8-435c-ad58-446b9a232a3b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:48.322186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:48.323114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:48.323390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:48.323692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] PATH_INFO: `/v3/users/0696571137224c288aacd23e9c5460ba` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:48.325072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0696571137224c288aacd23e9c5460ba)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:48.327016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:48.344292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:48.346748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:48.373489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1057/2086] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:48.390444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0696571137224c288aacd23e9c5460ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.391139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0696571137224c288aacd23e9c5460ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.407622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0696571137224c288aacd23e9c5460ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.417688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0696571137224c288aacd23e9c5460ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.418616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7bcdde9a-1248-4b5f-8fc6-fa60dab16984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0696571137224c288aacd23e9c5460ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:48.443601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1030/2087] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:48 2022] DELETE /identity/v3/users/0696571137224c288aacd23e9c5460ba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:48.793724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:48.838123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744bc55-615a-4a66-ae03-da606ead5b74 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:48.948870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:48.950863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:48.951156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:48.951439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] PATH_INFO: `/v3/projects/c2c25d9af53840e1bb139bb1714ad9f3` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:48.953669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c25d9af53840e1bb139bb1714ad9f3)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:48.957233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:48.971049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:49.057884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c25d9af53840e1bb139bb1714ad9f3', 'request_id': 'req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:49.064082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c25d9af53840e1bb139bb1714ad9f3', 'request_id': 'req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:49.074224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c25d9af53840e1bb139bb1714ad9f3', 'request_id': 'req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:49.091769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] The token cache is being invalidate because project c2c25d9af53840e1bb139bb1714ad9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:49.092118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:49.092981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-d4acf5bc-96e5-40df-8cb3-43f8cd2e475f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:49.094959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1058/2088] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:48 2022] DELETE /identity/v3/projects/c2c25d9af53840e1bb139bb1714ad9f3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:49.110208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.111585 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.112039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.134418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:49.135651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:49.189788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:49.283112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18dc62-fc3a-41e8-a08e-3f2ea5773dbf None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.283851 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18dc62-fc3a-41e8-a08e-3f2ea5773dbf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.284372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18dc62-fc3a-41e8-a08e-3f2ea5773dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.288628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1031/2089] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:49.292463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.294002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:49.313713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0b18dc62-fc3a-41e8-a08e-3f2ea5773dbf None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:49.315230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0b18dc62-fc3a-41e8-a08e-3f2ea5773dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:49.326746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1059/2090] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:49.332023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18dc62-fc3a-41e8-a08e-3f2ea5773dbf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.344699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18dc62-fc3a-41e8-a08e-3f2ea5773dbf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.349848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.350526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.350884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.351468 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.352266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:49.352523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.354373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.367487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1060/2091] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:56:49.370777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873fd5-9225-49c0-ac6f-6f07d8d49a19 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.371596 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.374611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.375266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.375552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.375825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.377641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:49.382188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159927aa-2f35-467a-84cd-5d70a93af8fd admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.389139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.389861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.390219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.392636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.393359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.396179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.428622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1061/2092] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:49 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:49.431278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.462099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.463611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.474087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1032/2093] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:49.533516 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd64e7-5f0b-4566-bfde-82c22b5d32db admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.542339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.543098 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.543461 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.543822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.544778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.546947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.573479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1062/2094] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:49 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:49.574664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.585116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5406e65-01c0-4668-bc00-266754c32dca service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.590343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.591074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.591383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.591626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.592433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.595085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.607918 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1033/2095] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:49.612119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.623073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7605-d83b-4f7b-b788-45a35814a173 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.627811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e1307-8f49-47c9-895a-48d35f3eafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.628476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e1307-8f49-47c9-895a-48d35f3eafb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.628799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e1307-8f49-47c9-895a-48d35f3eafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.629486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e1307-8f49-47c9-895a-48d35f3eafb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.629817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e1307-8f49-47c9-895a-48d35f3eafb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.632777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e1307-8f49-47c9-895a-48d35f3eafb4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.644626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1063/2096] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:49.648290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.658404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507743bc-e5b9-480a-9076-6776cc2177af admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.663674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.664559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.664881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.665157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] PATH_INFO: `/v3/projects/cb3d553b63da476895d937d8eed1f8b8/users/7bc8b5b7c8b6417fbd63684b8e3736cd/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.680357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3d553b63da476895d937d8eed1f8b8, user_id=7bc8b5b7c8b6417fbd63684b8e3736cd, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.683067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.695808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1034/2097] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:49 2022] PUT /identity/v3/projects/cb3d553b63da476895d937d8eed1f8b8/users/7bc8b5b7c8b6417fbd63684b8e3736cd/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:49.707369 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e511e-7c63-4366-8884-005a9d55167e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.707665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e511e-7c63-4366-8884-005a9d55167e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.707954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e511e-7c63-4366-8884-005a9d55167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.734873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-913e511e-7c63-4366-8884-005a9d55167e None None] MFA Rules not processed for user `7bc8b5b7c8b6417fbd63684b8e3736cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:49.736078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-913e511e-7c63-4366-8884-005a9d55167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:49.755715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:49.803339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1064/2098] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:49.808101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.857909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:49.872210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959d9b3-08c0-4271-b935-f0c7b1d18ea4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.876970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.877571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.877861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.878140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.878833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.880782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:49.908103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1035/2099] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:49 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:49.912396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e511e-7c63-4366-8884-005a9d55167e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:49.923478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e511e-7c63-4366-8884-005a9d55167e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:49.982748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:49.983796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:49.984293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:49.984788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:49.985543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:49.987582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:50.010778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1065/2100] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:49 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:56:50.012254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:50.023846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da8f3a-c472-4e20-9f5a-c638072cf3c9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:50.029778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:50.030445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:50.030736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:50.031017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:50.031746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:50.034898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:50.046670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1036/2101] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:50.050809 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:50.067199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a122cb0-324e-450f-a4ab-294ff0992abb admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:50.072399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:50.073425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:50.073714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:50.073998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] PATH_INFO: `/v3/projects/deb8ae8015c84ba3b910fe4e75b0f2ad/users/1d63aa7eb58946c8845ff9cdc03cd418/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:50.093435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb8ae8015c84ba3b910fe4e75b0f2ad, user_id=1d63aa7eb58946c8845ff9cdc03cd418, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:50.096655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:50.115330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1066/2102] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:50 2022] PUT /identity/v3/projects/deb8ae8015c84ba3b910fe4e75b0f2ad/users/1d63aa7eb58946c8845ff9cdc03cd418/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:50.121103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:50.132974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa1307-7a2b-4ea4-83c8-b7236847291a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:50.205527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263a21e-b39f-460d-99e9-6f7dd420dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:50.206448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263a21e-b39f-460d-99e9-6f7dd420dbbc admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:50.206732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263a21e-b39f-460d-99e9-6f7dd420dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:50.207013 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263a21e-b39f-460d-99e9-6f7dd420dbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:50.207778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263a21e-b39f-460d-99e9-6f7dd420dbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:50.212638 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263a21e-b39f-460d-99e9-6f7dd420dbbc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:50.224624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1037/2103] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:50.227545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:50.238354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7dfaa-c679-44f3-a7d6-6370a9a93cbc admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:50.244172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:50.245146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:50.245429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:50.245707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] PATH_INFO: `/v3/projects/deb8ae8015c84ba3b910fe4e75b0f2ad/users/1d63aa7eb58946c8845ff9cdc03cd418/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:50.248766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb8ae8015c84ba3b910fe4e75b0f2ad, user_id=1d63aa7eb58946c8845ff9cdc03cd418, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:50.252759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:50.265832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1067/2104] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:50 2022] PUT /identity/v3/projects/deb8ae8015c84ba3b910fe4e75b0f2ad/users/1d63aa7eb58946c8845ff9cdc03cd418/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:50.277144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:50.277441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:50.277722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:50.311394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] MFA Rules not processed for user `1d63aa7eb58946c8845ff9cdc03cd418`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:50.312649 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:50.386899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1038/2105] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:50.400630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:50.488778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c5e2b-731d-4003-bd04-6fe5711f1e83 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:50.494492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:50.495264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:50.495585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:50.495897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:50.512996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:50.514529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:50.525636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1068/2106] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:50.608488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:50.610183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:50.626388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad1c29-f151-4fed-9145-1e7dec2a45c9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:50.631975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8bbde-dbaa-4e18-ae16-bc7a879ace08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:50.633252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8bbde-dbaa-4e18-ae16-bc7a879ace08 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:50.633657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8bbde-dbaa-4e18-ae16-bc7a879ace08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:50.634347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8bbde-dbaa-4e18-ae16-bc7a879ace08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:50.689502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:50.715982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8bbde-dbaa-4e18-ae16-bc7a879ace08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:50.717826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8bbde-dbaa-4e18-ae16-bc7a879ace08 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:50.728665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1039/2107] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:51.225290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:51.226738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:51.247298 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:51.292376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cf1a-a989-40c5-a046-b84b38eadb4d service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:51.297003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:51.297878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:51.298194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:51.298478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] PATH_INFO: `/v3/users/06fd4e9660434da5b58b040ed3b22fb5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:51.299669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fd4e9660434da5b58b040ed3b22fb5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:51.302479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:51.349196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fd4e9660434da5b58b040ed3b22fb5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.356445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fd4e9660434da5b58b040ed3b22fb5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.368893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fd4e9660434da5b58b040ed3b22fb5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.369568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fd4e9660434da5b58b040ed3b22fb5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.370187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fd4e9660434da5b58b040ed3b22fb5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.382583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1069/2108] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:51 2022] DELETE /identity/v3/users/06fd4e9660434da5b58b040ed3b22fb5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:51.387160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:51.387595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:51.387755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:51.404339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:51.405569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:51.471439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1040/2109] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:51.481593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:51.482961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:51.502869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:51.504261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:51.516392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f8cd-844a-4a78-93e3-94652e4d1492 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:51.525163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:51.526188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:51.526555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:51.526957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] PATH_INFO: `/v3/users/da2e599d1c6b44fe885de44c625a97bb` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:51.528221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2e599d1c6b44fe885de44c625a97bb)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:51.530267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:51.545110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2f6d7-23b4-4f84-8972-2e4615b4fa8a admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:51.549543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2e4ad-7663-41e4-a8b0-a374652f19ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:51.550187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e4ad-7663-41e4-a8b0-a374652f19ac service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:51.550730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e4ad-7663-41e4-a8b0-a374652f19ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:51.551009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e4ad-7663-41e4-a8b0-a374652f19ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:51.563187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2e4ad-7663-41e4-a8b0-a374652f19ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:51.564778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2e4ad-7663-41e4-a8b0-a374652f19ac service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:51.575439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1070/2110] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:51.578150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2e599d1c6b44fe885de44c625a97bb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.578850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2e599d1c6b44fe885de44c625a97bb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.590852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2e599d1c6b44fe885de44c625a97bb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.598436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2e599d1c6b44fe885de44c625a97bb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.599144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2e599d1c6b44fe885de44c625a97bb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:51.615131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1041/2111] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:51 2022] DELETE /identity/v3/users/da2e599d1c6b44fe885de44c625a97bb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:51.620273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:51.620569 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:51.620879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:51.641343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:51.642486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:51.698845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:51.737533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1071/2112] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:51.752364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:51.753946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:51.834004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61298cb2-99f3-409a-b654-262f9bfbf93e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:51.839550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:51.840446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:51.840979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:51.841322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:51.849550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:51.853144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:51.858032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:51.873232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1042/2113] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:51.892745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:51.894724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:51.911478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53379a7-1175-429e-930b-48b8091ce485 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:51.924254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:51.925616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:51.926780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:51.926780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] PATH_INFO: `/v3/projects/4fb9163e959c4d1bb9c7ab0e391e9b98` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:51.928997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb9163e959c4d1bb9c7ab0e391e9b98)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:51.931443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:52.020264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb9163e959c4d1bb9c7ab0e391e9b98', 'request_id': 'req-cef417fd-6494-40fb-a885-eee38fef4137'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.028274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb9163e959c4d1bb9c7ab0e391e9b98', 'request_id': 'req-cef417fd-6494-40fb-a885-eee38fef4137'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.040592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb9163e959c4d1bb9c7ab0e391e9b98', 'request_id': 'req-cef417fd-6494-40fb-a885-eee38fef4137'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.073396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] The token cache is being invalidate because project 4fb9163e959c4d1bb9c7ab0e391e9b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:52.073792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.076230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.081187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1072/2114] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:51 2022] DELETE /identity/v3/projects/4fb9163e959c4d1bb9c7ab0e391e9b98 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:52.082365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:52.094021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd1e2-c622-49cb-bd10-1230bbb4bb17 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:52.213476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:52.217936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:52.221281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:52.221281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] PATH_INFO: `/v3/users/09b3819d481a456c8cd216895f31491f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:52.222657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b3819d481a456c8cd216895f31491f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:52.226728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:52.251800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:52.253480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:52.267911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef417fd-6494-40fb-a885-eee38fef4137 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:52.279045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:52.279990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:52.280287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:52.280944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] PATH_INFO: `/v3/projects/27f6eb98f1cc4a7d8f49b97c97676f4a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:52.282047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f6eb98f1cc4a7d8f49b97c97676f4a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:52.284190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:52.307794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b3819d481a456c8cd216895f31491f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.308497 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b3819d481a456c8cd216895f31491f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.329909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b3819d481a456c8cd216895f31491f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.342828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b3819d481a456c8cd216895f31491f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.343929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b3819d481a456c8cd216895f31491f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.360459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f6eb98f1cc4a7d8f49b97c97676f4a', 'request_id': 'req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.366848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f6eb98f1cc4a7d8f49b97c97676f4a', 'request_id': 'req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.376688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1043/2115] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:52 2022] DELETE /identity/v3/users/09b3819d481a456c8cd216895f31491f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:52.388012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f6eb98f1cc4a7d8f49b97c97676f4a', 'request_id': 'req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.410040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] The token cache is being invalidate because project 27f6eb98f1cc4a7d8f49b97c97676f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:52.410549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.411179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.413323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1073/2116] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:52 2022] DELETE /identity/v3/projects/27f6eb98f1cc4a7d8f49b97c97676f4a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:52.418424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:52.420060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:52.550056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c9d8-1e74-4c3f-a3df-bdd5a0623449 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:52.565183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:52.566325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:52.566610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:52.566971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] PATH_INFO: `/v3/users/237e2e5eec7b43b7b0b98deacf205dba` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:52.568258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237e2e5eec7b43b7b0b98deacf205dba)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:52.576279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:52.592788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:52.632179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237e2e5eec7b43b7b0b98deacf205dba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.632922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237e2e5eec7b43b7b0b98deacf205dba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.647986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237e2e5eec7b43b7b0b98deacf205dba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.655281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237e2e5eec7b43b7b0b98deacf205dba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.656010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-bf865921-e322-499d-a1d6-98627637ba86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237e2e5eec7b43b7b0b98deacf205dba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.670195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1044/2117] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:52 2022] DELETE /identity/v3/users/237e2e5eec7b43b7b0b98deacf205dba => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:52.753239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:52.755082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:52.815744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:52.835191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3ee8d-704c-4e5f-802f-cb9adf75c88d admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:52.903689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:52.904690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:52.905173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:52.908424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] PATH_INFO: `/v3/projects/c1e515c43fb34343843b93dabc85c4a0` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:52.909797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e515c43fb34343843b93dabc85c4a0)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:52.911805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:52.966996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e515c43fb34343843b93dabc85c4a0', 'request_id': 'req-526908f4-a1f3-4189-9c00-1ab859c0add1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.972576 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e515c43fb34343843b93dabc85c4a0', 'request_id': 'req-526908f4-a1f3-4189-9c00-1ab859c0add1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.980971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e515c43fb34343843b93dabc85c4a0', 'request_id': 'req-526908f4-a1f3-4189-9c00-1ab859c0add1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.995529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] The token cache is being invalidate because project c1e515c43fb34343843b93dabc85c4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:52.995824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.996477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:52.998061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1074/2118] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:52 2022] DELETE /identity/v3/projects/c1e515c43fb34343843b93dabc85c4a0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:53.003322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021a09-a6c5-4fbd-846e-0d33e15646a0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.003620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021a09-a6c5-4fbd-846e-0d33e15646a0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.003928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021a09-a6c5-4fbd-846e-0d33e15646a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.022711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-4e021a09-a6c5-4fbd-846e-0d33e15646a0 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:53.024305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4e021a09-a6c5-4fbd-846e-0d33e15646a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.039155 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.042043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.104016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1045/2119] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:53.112197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4306ac-a40f-407c-ba4d-f2602f392c51 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.112556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4306ac-a40f-407c-ba4d-f2602f392c51 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.113049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4306ac-a40f-407c-ba4d-f2602f392c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.124058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526908f4-a1f3-4189-9c00-1ab859c0add1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.128559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.129524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.129882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.130363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] PATH_INFO: `/v3/projects/70db5e45dd704e16a6be86608d1c703d` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.132186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70db5e45dd704e16a6be86608d1c703d)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.134302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.135871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ac4306ac-a40f-407c-ba4d-f2602f392c51 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:53.137299 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ac4306ac-a40f-407c-ba4d-f2602f392c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.145528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1046/2120] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:53.150328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4306ac-a40f-407c-ba4d-f2602f392c51 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.160897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4306ac-a40f-407c-ba4d-f2602f392c51 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.166828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.167539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.167829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.168112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.168883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:53.169204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.170955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.177488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:53.189830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1047/2121] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:56:53.190775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.202403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf7df-0c4d-4ace-a736-d4f2b3bfbdfc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.207827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70db5e45dd704e16a6be86608d1c703d', 'request_id': 'req-02edb408-6854-4dfa-bd42-807c603a4e64'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.219638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70db5e45dd704e16a6be86608d1c703d', 'request_id': 'req-02edb408-6854-4dfa-bd42-807c603a4e64'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.229187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70db5e45dd704e16a6be86608d1c703d', 'request_id': 'req-02edb408-6854-4dfa-bd42-807c603a4e64'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.242704 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] The token cache is being invalidate because project 70db5e45dd704e16a6be86608d1c703d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:53.243077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.243740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-02edb408-6854-4dfa-bd42-807c603a4e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.246078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1075/2122] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:53 2022] DELETE /identity/v3/projects/70db5e45dd704e16a6be86608d1c703d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:53.254537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965f88-3d6f-40c7-82e6-4326aef9e040 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.255133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965f88-3d6f-40c7-82e6-4326aef9e040 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.255133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965f88-3d6f-40c7-82e6-4326aef9e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.276729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-59965f88-3d6f-40c7-82e6-4326aef9e040 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:53.277857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-59965f88-3d6f-40c7-82e6-4326aef9e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.293104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.293502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.293792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.294099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.294805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.297236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.325029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:53.337560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1048/2123] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:53.338393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.342329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.357774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1076/2124] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:53.359644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512fe7-8d19-4cf4-b7fa-94451264ae60 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.359968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512fe7-8d19-4cf4-b7fa-94451264ae60 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.360232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512fe7-8d19-4cf4-b7fa-94451264ae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.389702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-91512fe7-8d19-4cf4-b7fa-94451264ae60 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:53.390937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-91512fe7-8d19-4cf4-b7fa-94451264ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.413277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba020-df8b-432e-b23d-de2ce7c08a62 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.419031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.419990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.420867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.420867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.421592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.423684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.448048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1049/2125] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/users => generated 305 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:53.452176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.464140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8975b-c316-495a-a580-a5dfdd410fb0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.471485 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1077/2126] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:53.473527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.474490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.475025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.475516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.475985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91512fe7-8d19-4cf4-b7fa-94451264ae60 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.476754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.478626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.487230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91512fe7-8d19-4cf4-b7fa-94451264ae60 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.492411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1050/2127] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:56:53.495924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.497143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.498063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.498350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.498632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.499394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:56:53.499710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.501411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.515018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b321-12c0-4840-8caa-b0ee85bcf9ec admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.516286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1078/2128] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:56:53.521081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.523862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.524559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.524937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.525229 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.525975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.527678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.533916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cbe32-f0fa-4b29-8164-25cd1d8ff383 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.538737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.539407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.539696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.540027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1051/2129] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:53.540323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.541100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.543565 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.546241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.565400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226bd9f-5e16-4746-a9da-6f306fcf682a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.583696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.584886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.585176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.585495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] PATH_INFO: `/v3/projects/d9fb76010b814377bbe46e5962028baf/users/bbd79080530d469c949f404a1893f5ec/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.595068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1079/2130] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:53.599241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.624936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fb76010b814377bbe46e5962028baf, user_id=bbd79080530d469c949f404a1893f5ec, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.627792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.636553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:53.658331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1052/2131] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:53 2022] PUT /identity/v3/projects/d9fb76010b814377bbe46e5962028baf/users/bbd79080530d469c949f404a1893f5ec/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:53.659511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.661389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.706996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1636e94-b365-4968-8f64-86a44027130d admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.753665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a3af8-428e-4b71-91cf-cf24c59727c8 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:53.759037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.759938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.760222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.760495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] PATH_INFO: `/v3/users/98faa0823a9248719e32f7f71a15be7b` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.762656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98faa0823a9248719e32f7f71a15be7b)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.765006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.775761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8edc-5895-4b7f-984b-4fa4acfa8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:53.776496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8edc-5895-4b7f-984b-4fa4acfa8d32 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.776881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8edc-5895-4b7f-984b-4fa4acfa8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.778199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8edc-5895-4b7f-984b-4fa4acfa8d32 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.778199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8edc-5895-4b7f-984b-4fa4acfa8d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:53.779988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8edc-5895-4b7f-984b-4fa4acfa8d32 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:53.828897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1080/2132] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:53.830533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369b80-8599-4ac2-985b-b624492a19dc None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:53.830836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369b80-8599-4ac2-985b-b624492a19dc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:53.831123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369b80-8599-4ac2-985b-b624492a19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:53.855763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:53.858085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98faa0823a9248719e32f7f71a15be7b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.858857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98faa0823a9248719e32f7f71a15be7b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.878819 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0f369b80-8599-4ac2-985b-b624492a19dc None None] MFA Rules not processed for user `bbd79080530d469c949f404a1893f5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:53.880895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98faa0823a9248719e32f7f71a15be7b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.881474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0f369b80-8599-4ac2-985b-b624492a19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:53.889402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98faa0823a9248719e32f7f71a15be7b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.890566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98faa0823a9248719e32f7f71a15be7b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:53.915062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1053/2133] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:53 2022] DELETE /identity/v3/users/98faa0823a9248719e32f7f71a15be7b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:53.917620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:53.920639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.017326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1081/2134] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:54.019120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.019642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.019999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.035895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54de366-a0ee-4a48-b9ff-b1d592d1857f admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.043334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.045550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.046192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.046627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.047462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.052150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:54.054155 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.054999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.062639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1082/2135] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:54.063417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.064862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.074821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1054/2136] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:54.083788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.087056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.090423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794c0fb-1ee0-4263-8bca-98edcaee3937 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.095716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.096540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.096925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.097597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.098445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.100893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.160542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1083/2137] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:56:54 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:54.161694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.200388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:54.275457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f86879-0fdb-473e-af9e-8b5c6f2e4de3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.309322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a2fca-8482-4db2-8d99-3a8c44f293ec admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.320838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.321612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.321901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.322189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.322930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.324684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.338831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1084/2138] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:54.338831 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.344112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.345654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.346016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.346302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.349577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2a33-ec1a-4a6c-9c46-d9c13e2b5895 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.355892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.356562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.356872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.357151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.357616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.357903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.359336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.359731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.369975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1055/2139] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:54.373272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.385289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d4c94-14c2-4f26-bb38-bf2c2d8f07c7 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.390933 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5327-478b-4cca-811d-6cf6893968f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.392005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5327-478b-4cca-811d-6cf6893968f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.392450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5327-478b-4cca-811d-6cf6893968f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.392820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5327-478b-4cca-811d-6cf6893968f6 admin admin] PATH_INFO: `/v3/projects/daae77ba94fc4aa7b632002da6304ceb/users/171a776a46b74b78aeded3ceee42647a/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.395665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1085/2140] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:56:54 2022] POST /identity/v3/users => generated 311 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:56:54.396562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.409656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5327-478b-4cca-811d-6cf6893968f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daae77ba94fc4aa7b632002da6304ceb, user_id=171a776a46b74b78aeded3ceee42647a, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.413762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5327-478b-4cca-811d-6cf6893968f6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.416479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:54.422576 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2a2fe-14ba-40e4-b081-828ac23f9b83 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.435466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1056/2141] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:54 2022] PUT /identity/v3/projects/daae77ba94fc4aa7b632002da6304ceb/users/171a776a46b74b78aeded3ceee42647a/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:54.441395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.442086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.442378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.442661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.443408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.445278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.448676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.449044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.449391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.460051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1086/2142] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:54.464591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.485615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa2c34-03cc-4dd5-b9ea-39227d1a28aa admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.511644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] MFA Rules not processed for user `171a776a46b74b78aeded3ceee42647a`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:54.513492 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.578768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.581196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.582099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.582741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] PATH_INFO: `/v3/projects/d9f12361651847e78ad83abc6170b5df/users/068e8c3213ec40d59f17f5ac281e9bf4/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.622345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f12361651847e78ad83abc6170b5df, user_id=068e8c3213ec40d59f17f5ac281e9bf4, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.625436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.637590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1057/2143] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:56:54.646815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1087/2144] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:54 2022] PUT /identity/v3/projects/d9f12361651847e78ad83abc6170b5df/users/068e8c3213ec40d59f17f5ac281e9bf4/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:54.647801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.647941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.649832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.712564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f3ca5-66a4-4d4f-bfd1-0f78a767c5b0 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.730848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4b99f-fd56-420c-8c7f-feca162873d8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.735802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.736477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.736820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.737110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.737965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.739726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.753265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1088/2145] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:56:54.753986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.758038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.772128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:54.776384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf5c8-e2bd-4e90-bfc4-adb014fc3bc3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.783452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.784322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.784419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.784634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.784915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] PATH_INFO: `/v3/projects/c948a4e90dd245bc9e4eae0aaa484997` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.785099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.785385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.785664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.786810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c948a4e90dd245bc9e4eae0aaa484997)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.789474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.839581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c948a4e90dd245bc9e4eae0aaa484997', 'request_id': 'req-7f657531-cfe1-4a2b-bca6-89e909071223'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:54.843811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:54.845161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c948a4e90dd245bc9e4eae0aaa484997', 'request_id': 'req-7f657531-cfe1-4a2b-bca6-89e909071223'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:54.847833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.851243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.853538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c948a4e90dd245bc9e4eae0aaa484997', 'request_id': 'req-7f657531-cfe1-4a2b-bca6-89e909071223'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:54.865883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1058/2146] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:54.866815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.870881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] The token cache is being invalidate because project c948a4e90dd245bc9e4eae0aaa484997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:54.871340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:54.871964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:54.873836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1089/2147] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:54 2022] DELETE /identity/v3/projects/c948a4e90dd245bc9e4eae0aaa484997 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:54.877635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:54.878271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c696b8-1e16-4f26-941b-e479a0e33b02 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.878938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:54.946184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63892abc-9315-4b68-a0fb-0ea730b34d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.947236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892abc-9315-4b68-a0fb-0ea730b34d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.947538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892abc-9315-4b68-a0fb-0ea730b34d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.947823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892abc-9315-4b68-a0fb-0ea730b34d62 admin admin] PATH_INFO: `/v3/projects/d9f12361651847e78ad83abc6170b5df/users/068e8c3213ec40d59f17f5ac281e9bf4/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.949852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63892abc-9315-4b68-a0fb-0ea730b34d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f12361651847e78ad83abc6170b5df, user_id=068e8c3213ec40d59f17f5ac281e9bf4, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.952526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63892abc-9315-4b68-a0fb-0ea730b34d62 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.954264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657531-cfe1-4a2b-bca6-89e909071223 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:54.960517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:54.962122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.962414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.962961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] PATH_INFO: `/v3/users/95d35808342943ea963bf61597663c1a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:54.964356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d35808342943ea963bf61597663c1a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:54.965994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1059/2148] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:56:54 2022] PUT /identity/v3/projects/d9f12361651847e78ad83abc6170b5df/users/068e8c3213ec40d59f17f5ac281e9bf4/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:54.966350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:54.976831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:54.977131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:54.977654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:55.011089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] MFA Rules not processed for user `068e8c3213ec40d59f17f5ac281e9bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:55.012474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:55.028214 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d35808342943ea963bf61597663c1a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.038993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d35808342943ea963bf61597663c1a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.062885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d35808342943ea963bf61597663c1a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.063755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d35808342943ea963bf61597663c1a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.064807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d35808342943ea963bf61597663c1a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.081051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1090/2149] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:54 2022] DELETE /identity/v3/users/95d35808342943ea963bf61597663c1a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:56:55.120784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1060/2150] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:56:55.201586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:55.203911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:55.219105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:55.310073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561416-cd29-4e76-8ac8-dc36049f50b0 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:55.314084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:55.314755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:55.315030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:55.315316 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:55.378264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:55.379625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:55.392013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1091/2151] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:56:55.437714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:55.439685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:55.527859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfc6bc-0e14-478f-85e8-c76dc7cb2600 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:55.545338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:55.594105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:55.594992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:55.595359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:55.595545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] PATH_INFO: `/v3/projects/d3f70c2ac18d458dac20ca9223f0ba23` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:55.596782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f70c2ac18d458dac20ca9223f0ba23)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:55.598718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:55.658401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f70c2ac18d458dac20ca9223f0ba23', 'request_id': 'req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.662957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:55.669635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f70c2ac18d458dac20ca9223f0ba23', 'request_id': 'req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.673282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebae5d5-8a48-4af9-99e5-3c289b99b7e5 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:55.678294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f70c2ac18d458dac20ca9223f0ba23', 'request_id': 'req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.690695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] The token cache is being invalidate because project d3f70c2ac18d458dac20ca9223f0ba23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:55.691014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.692162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.696998 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1061/2152] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:55 2022] DELETE /identity/v3/projects/d3f70c2ac18d458dac20ca9223f0ba23 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:55.697989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:55.700302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:55.731040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:55.731701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:55.731988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:55.732271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:55.734367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:55.778856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc92c7-cd0b-49a4-ae0c-e1c24bcf4553 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:55.789161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:55.789161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:55.789161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:55.789161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] PATH_INFO: `/v3/users/b252b95ad1f044e99676a93feec882ba` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:55.789445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b252b95ad1f044e99676a93feec882ba)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:55.789445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:55.803266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:55.804731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:55.813666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1092/2153] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:56:55.838538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b252b95ad1f044e99676a93feec882ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.839218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b252b95ad1f044e99676a93feec882ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.843694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:55.852931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b252b95ad1f044e99676a93feec882ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.860193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b252b95ad1f044e99676a93feec882ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.860946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-63250c7c-6e1c-4dbd-a6cf-5fb0ce888495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b252b95ad1f044e99676a93feec882ba'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:55.874020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1062/2154] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:56:55 2022] DELETE /identity/v3/users/b252b95ad1f044e99676a93feec882ba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:56.172624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:56:56.192698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3534cac-5c0c-46b7-af7b-f821858335ba service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:56:56.201381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:56:56.255438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:56:56.256436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:56.256755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:56.257039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] PATH_INFO: `/v3/projects/641c36aa2b534f489d63a54dea300d12` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:56.258236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=641c36aa2b534f489d63a54dea300d12)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:56:56.260138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:56:56.306083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641c36aa2b534f489d63a54dea300d12', 'request_id': 'req-1cdfaf16-488b-47e1-80c5-8196f20f73aa'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:56.311464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641c36aa2b534f489d63a54dea300d12', 'request_id': 'req-1cdfaf16-488b-47e1-80c5-8196f20f73aa'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:56.319082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641c36aa2b534f489d63a54dea300d12', 'request_id': 'req-1cdfaf16-488b-47e1-80c5-8196f20f73aa'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:56.330949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] The token cache is being invalidate because project 641c36aa2b534f489d63a54dea300d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:56:56.331242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:56.331901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:56:56.333512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1093/2155] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:56:56 2022] DELETE /identity/v3/projects/641c36aa2b534f489d63a54dea300d12 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:56:58.665598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d8677-d413-4671-8ce5-aa6366262e34 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:56:58.666120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d8677-d413-4671-8ce5-aa6366262e34 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:56:58.666120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d8677-d413-4671-8ce5-aa6366262e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:56:58.687695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-602d8677-d413-4671-8ce5-aa6366262e34 None None] MFA Rules not processed for user `171a776a46b74b78aeded3ceee42647a`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:56:58.689182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-602d8677-d413-4671-8ce5-aa6366262e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:56:58.756072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1063/2156] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:03.903349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:03.905726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:03.998374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfaf16-488b-47e1-80c5-8196f20f73aa admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:04.003523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:04.004451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:04.004812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:04.005086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] PATH_INFO: `/v3/users/7bc8b5b7c8b6417fbd63684b8e3736cd` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:04.006420 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc8b5b7c8b6417fbd63684b8e3736cd)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:04.008422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:04.078040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:04.080803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc8b5b7c8b6417fbd63684b8e3736cd'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.101462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc8b5b7c8b6417fbd63684b8e3736cd'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.115824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc8b5b7c8b6417fbd63684b8e3736cd'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.116573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc8b5b7c8b6417fbd63684b8e3736cd'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.121736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc8b5b7c8b6417fbd63684b8e3736cd'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.139130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1094/2157] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:03 2022] DELETE /identity/v3/users/7bc8b5b7c8b6417fbd63684b8e3736cd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:04.143722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:04.144195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:04.144308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:04.167916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:04.167916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:04.238148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1064/2158] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:04.251966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:04.253540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:04.319817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6013d6-ae1b-4527-8491-bdbbe1210720 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:04.323986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:04.324687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:04.324978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:04.325259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:04.343472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:04.344788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:04.355003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1095/2159] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:04.510717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:04.512552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:04.540365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435cdec-7223-4b1c-b8ce-27eee5df9ae4 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:04.550254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:04.551921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:04.552267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:04.552623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] PATH_INFO: `/v3/users/4e4769e15ff54700be019d0b0dee5f64` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:04.555589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4769e15ff54700be019d0b0dee5f64)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:04.558291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:04.630225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4769e15ff54700be019d0b0dee5f64'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.630719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4769e15ff54700be019d0b0dee5f64'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.653413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4769e15ff54700be019d0b0dee5f64'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.666197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:04.670941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4769e15ff54700be019d0b0dee5f64'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.682647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4769e15ff54700be019d0b0dee5f64'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.718599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1065/2160] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:04 2022] DELETE /identity/v3/users/4e4769e15ff54700be019d0b0dee5f64 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:04.737868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:04.737868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:04.750438 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee561-cfac-4127-9f31-103f65ad7a43 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:04.818006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:04.819271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:04.819679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:04.819997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] PATH_INFO: `/v3/projects/cb3d553b63da476895d937d8eed1f8b8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:04.821523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3d553b63da476895d937d8eed1f8b8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:04.824142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:04.888350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3d553b63da476895d937d8eed1f8b8', 'request_id': 'req-2eb1b068-6069-458a-81f2-e1bea428d648'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.894188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3d553b63da476895d937d8eed1f8b8', 'request_id': 'req-2eb1b068-6069-458a-81f2-e1bea428d648'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.905223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3d553b63da476895d937d8eed1f8b8', 'request_id': 'req-2eb1b068-6069-458a-81f2-e1bea428d648'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.906577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:04.922184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] The token cache is being invalidate because project cb3d553b63da476895d937d8eed1f8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:04.922482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.923145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:04.924733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1096/2161] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:04 2022] DELETE /identity/v3/projects/cb3d553b63da476895d937d8eed1f8b8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:04.929171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:04.930573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:04.945975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3a3d-cae1-4f3a-bafd-a9c94d90a251 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:05.012476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:05.013427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.013720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.014001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] PATH_INFO: `/v3/users/1d63aa7eb58946c8845ff9cdc03cd418` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.018096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d63aa7eb58946c8845ff9cdc03cd418)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:05.020151 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:05.072024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d63aa7eb58946c8845ff9cdc03cd418'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.072635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d63aa7eb58946c8845ff9cdc03cd418'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.086615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d63aa7eb58946c8845ff9cdc03cd418'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.093881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d63aa7eb58946c8845ff9cdc03cd418'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.094623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-abd1ec85-d9dc-4add-8d97-2cd87ce007c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d63aa7eb58946c8845ff9cdc03cd418'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.117797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1066/2162] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:04 2022] DELETE /identity/v3/users/1d63aa7eb58946c8845ff9cdc03cd418 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:05.228680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:05.231090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:05.255402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1b068-6069-458a-81f2-e1bea428d648 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:05.350633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:05.351599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.351954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.352168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] PATH_INFO: `/v3/projects/8861f7058f96459fa715dddf23cc3908` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.353552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8861f7058f96459fa715dddf23cc3908)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:05.355618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:05.422380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8861f7058f96459fa715dddf23cc3908', 'request_id': 'req-8b365414-f1cc-4fb7-82ee-071a12a647e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.428684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8861f7058f96459fa715dddf23cc3908', 'request_id': 'req-8b365414-f1cc-4fb7-82ee-071a12a647e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.439435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8861f7058f96459fa715dddf23cc3908', 'request_id': 'req-8b365414-f1cc-4fb7-82ee-071a12a647e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.451717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] The token cache is being invalidate because project 8861f7058f96459fa715dddf23cc3908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:05.452007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.452698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-8b365414-f1cc-4fb7-82ee-071a12a647e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.454287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1097/2163] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:05 2022] DELETE /identity/v3/projects/8861f7058f96459fa715dddf23cc3908 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:05.459370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2215ec-7632-4a35-a47d-d374e9359141 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.459848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2215ec-7632-4a35-a47d-d374e9359141 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.460056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2215ec-7632-4a35-a47d-d374e9359141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.484265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2d2215ec-7632-4a35-a47d-d374e9359141 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:05.485641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2d2215ec-7632-4a35-a47d-d374e9359141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:05.577618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1067/2164] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:05.580010 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c517bc-3064-4fa2-9113-9bf64611bee7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.584307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c517bc-3064-4fa2-9113-9bf64611bee7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.584677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c517bc-3064-4fa2-9113-9bf64611bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.606647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-17c517bc-3064-4fa2-9113-9bf64611bee7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:05.608329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-17c517bc-3064-4fa2-9113-9bf64611bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:05.618148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1098/2165] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:05.622522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2215ec-7632-4a35-a47d-d374e9359141 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:05.633437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2215ec-7632-4a35-a47d-d374e9359141 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:05.639443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:05.640631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.641223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.641769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.647910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:05.652904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:05.654668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:05.658836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:05.672364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1068/2166] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:57:05.676125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c517bc-3064-4fa2-9113-9bf64611bee7 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:05.688946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c517bc-3064-4fa2-9113-9bf64611bee7 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:05.695332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:05.696041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.696350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.696688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.697396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:05.699359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:05.709754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:05.712080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:05.730137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16043e6-e79b-4b9c-b5e9-6aea74551a7a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:05.734521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1099/2167] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:05 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:05.735758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:05.738076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.738807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.738807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] PATH_INFO: `/v3/projects/deb8ae8015c84ba3b910fe4e75b0f2ad` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.740050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb8ae8015c84ba3b910fe4e75b0f2ad)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:05.741094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:05.742819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:05.817701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb8ae8015c84ba3b910fe4e75b0f2ad', 'request_id': 'req-5a564539-c480-4a54-85e2-5779992210ad'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.828238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:05.831581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb8ae8015c84ba3b910fe4e75b0f2ad', 'request_id': 'req-5a564539-c480-4a54-85e2-5779992210ad'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.834828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615530e6-c1d5-408a-b953-7474e986dfd3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:05.840688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb8ae8015c84ba3b910fe4e75b0f2ad', 'request_id': 'req-5a564539-c480-4a54-85e2-5779992210ad'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.856145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] The token cache is being invalidate because project deb8ae8015c84ba3b910fe4e75b0f2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:05.856988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.858046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5a564539-c480-4a54-85e2-5779992210ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:05.860000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1069/2168] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:05 2022] DELETE /identity/v3/projects/deb8ae8015c84ba3b910fe4e75b0f2ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:05.865062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24669d7-3162-4eaa-b2c0-c41b887a4106 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.865924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24669d7-3162-4eaa-b2c0-c41b887a4106 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.866525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24669d7-3162-4eaa-b2c0-c41b887a4106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.895690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a24669d7-3162-4eaa-b2c0-c41b887a4106 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:05.898015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a24669d7-3162-4eaa-b2c0-c41b887a4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:05.905713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:05.906756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.906756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.907109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.907821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:05.909804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:05.939001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1100/2169] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:05 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:05.943513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:05.948667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:05.983677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ca12d-1468-4f72-8ff3-958164be9622 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:05.989573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:05.990294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:05.990591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:05.990872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:05.991616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:05.993548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.007455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1101/2170] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:57:06.011209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.022985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadba14-a631-4d05-b393-737a66f41c16 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.025874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1070/2171] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:06.032798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.033797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.034147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.034337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.035059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.036754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.038897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ed1eb-9098-4f18-87ed-e8ca5c8071d9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.039056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ed1eb-9098-4f18-87ed-e8ca5c8071d9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.039346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ed1eb-9098-4f18-87ed-e8ca5c8071d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.052624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1102/2172] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:57:06.056432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.067226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-674ed1eb-9098-4f18-87ed-e8ca5c8071d9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:06.071449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-674ed1eb-9098-4f18-87ed-e8ca5c8071d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:06.074786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e25666-4511-4ccf-bb10-c1974b5dd461 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.081273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1071/2173] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:06.081836 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2221a-4dc9-4489-bdb3-7534798850c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.082769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2221a-4dc9-4489-bdb3-7534798850c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.083060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2221a-4dc9-4489-bdb3-7534798850c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.083347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2221a-4dc9-4489-bdb3-7534798850c4 admin admin] PATH_INFO: `/v3/projects/c9a08f2c9b8b49f6a5de343bf8826601/users/88c71f6ddf364c9baca69e459547ab02/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.085643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ed1eb-9098-4f18-87ed-e8ca5c8071d9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.098395 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ed1eb-9098-4f18-87ed-e8ca5c8071d9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.103286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2221a-4dc9-4489-bdb3-7534798850c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a08f2c9b8b49f6a5de343bf8826601, user_id=88c71f6ddf364c9baca69e459547ab02, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.105256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.106159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.106616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.107051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.107638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2221a-4dc9-4489-bdb3-7534798850c4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.108332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:06.108916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.110606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.123551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1103/2174] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:06 2022] PUT /identity/v3/projects/c9a08f2c9b8b49f6a5de343bf8826601/users/88c71f6ddf364c9baca69e459547ab02/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:06.126469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1072/2175] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:57:06.128290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.128615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.128920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.130972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.145055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892f22-3541-4f82-b2ce-923661d5e44d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.150604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:06.152411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:06.219729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:06.230026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.230659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.230921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.231826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.232545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.236957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.238564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1104/2176] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:06.254263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.257925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:06.281414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1073/2177] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:06.282564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.331959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:06.342832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df44a-9579-4a5c-8c94-d9daab954705 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.364890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af3941-c40c-4474-94cb-ce1091e59555 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.370232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.370996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.371283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.371566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.372262 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.374239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.401727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1074/2178] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:06.406871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.419288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debba99-82af-4667-a890-04284dd9ed65 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.425312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.426137 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.426888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.427068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.427368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.427483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.427819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.427938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.429066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.430915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.439184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.440860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.446610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1075/2179] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:06.450759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.460529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1105/2180] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:06.463866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8884-605d-4aef-90c5-129d96196ac5 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.469512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2dd21-403b-4bef-bb29-144c6cdbfef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.470369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2dd21-403b-4bef-bb29-144c6cdbfef8 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.470733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2dd21-403b-4bef-bb29-144c6cdbfef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.471092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2dd21-403b-4bef-bb29-144c6cdbfef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.471921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2dd21-403b-4bef-bb29-144c6cdbfef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.473648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2dd21-403b-4bef-bb29-144c6cdbfef8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.500778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1076/2181] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:57:06.505448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.519359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e0a65-de21-4863-ba1a-32f48980c397 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.526339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.527779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.529231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.529231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] PATH_INFO: `/v3/projects/f8bf16292879468b91bf671b7a48ab05/users/d9ad849326de42ba8d4fbbf72882c427/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.549972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8bf16292879468b91bf671b7a48ab05, user_id=d9ad849326de42ba8d4fbbf72882c427, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.553107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.574022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1106/2182] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:06 2022] PUT /identity/v3/projects/f8bf16292879468b91bf671b7a48ab05/users/d9ad849326de42ba8d4fbbf72882c427/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:06.585936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716850ea-e7bb-4143-8e5a-28af0ec1200d None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.586225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716850ea-e7bb-4143-8e5a-28af0ec1200d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.586425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716850ea-e7bb-4143-8e5a-28af0ec1200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.614047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-716850ea-e7bb-4143-8e5a-28af0ec1200d None None] MFA Rules not processed for user `d9ad849326de42ba8d4fbbf72882c427`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:06.615248 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-716850ea-e7bb-4143-8e5a-28af0ec1200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:06.617887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.620053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:06.710309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0170-a072-4e36-9f40-a3d5cfcd331c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.712739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1077/2183] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:06.716566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.717413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716850ea-e7bb-4143-8e5a-28af0ec1200d None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.719771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.720074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.720363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] PATH_INFO: `/v3/users/bbd79080530d469c949f404a1893f5ec` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.722293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd79080530d469c949f404a1893f5ec)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.725838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.736990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716850ea-e7bb-4143-8e5a-28af0ec1200d None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.747246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.748088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.748357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.748684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.749396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.751488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:06.785501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd79080530d469c949f404a1893f5ec'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:06.785864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1078/2184] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:06.789557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:06.797543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd79080530d469c949f404a1893f5ec'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:06.820612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:06.827563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd79080530d469c949f404a1893f5ec'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:06.828383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd79080530d469c949f404a1893f5ec'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:06.829936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1da1eeb2-32e6-44d6-aa34-54789067e0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd79080530d469c949f404a1893f5ec'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:06.848514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:06.855402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1107/2185] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:06 2022] DELETE /identity/v3/users/bbd79080530d469c949f404a1893f5ec => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:57:06.861256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.863032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.864000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.891877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f9e1-dff5-4b40-81d7-1c2496cf86f1 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:06.894319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:06.895632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:06.994413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:06.995415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:06.995898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:06.996359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:06.997343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:06.998871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1108/2186] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:07.000157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.017393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.018945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:07.047895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1079/2187] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:06 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:07.049200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.051775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:07.072487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7168-2512-4ac2-a615-5b67116875bf admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.082348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.083185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.083574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.084007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.085562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.087651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.120601 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1080/2188] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:07.122430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.122666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202f35e-bcf5-4a4c-9623-42ed92c36979 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.127133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.127789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.128082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.128359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.139265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.139628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d519c2-a848-402e-9697-d041a2b91430 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.140782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.145333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.147411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.147704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.147988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] PATH_INFO: `/v3/projects/9f937b55dc74497ea03170c2f8eda32f/users/3d08606d61a74c2e96442b57e1df850b/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.151918 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1109/2189] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:07.166340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f937b55dc74497ea03170c2f8eda32f, user_id=3d08606d61a74c2e96442b57e1df850b, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.169088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.185754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1081/2190] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:07 2022] PUT /identity/v3/projects/9f937b55dc74497ea03170c2f8eda32f/users/3d08606d61a74c2e96442b57e1df850b/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:07.190874 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.202053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc6940-195d-4197-bd5a-f712a49eb753 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.276106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46456ae2-412d-4540-a9d2-323ceea6dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.276868 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456ae2-412d-4540-a9d2-323ceea6dd8b admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.277155 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456ae2-412d-4540-a9d2-323ceea6dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.277715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456ae2-412d-4540-a9d2-323ceea6dd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.278291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46456ae2-412d-4540-a9d2-323ceea6dd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.280196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46456ae2-412d-4540-a9d2-323ceea6dd8b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.292048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1110/2191] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:07.296222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.309847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435c87-b4a2-497d-a24e-8604946540f0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.332781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.333701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.334606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.335055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] PATH_INFO: `/v3/projects/9f937b55dc74497ea03170c2f8eda32f/users/3d08606d61a74c2e96442b57e1df850b/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.346167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f937b55dc74497ea03170c2f8eda32f, user_id=3d08606d61a74c2e96442b57e1df850b, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.351323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.367821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1082/2192] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:07 2022] PUT /identity/v3/projects/9f937b55dc74497ea03170c2f8eda32f/users/3d08606d61a74c2e96442b57e1df850b/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:57:07.379085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.379085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.379085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.431611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] MFA Rules not processed for user `3d08606d61a74c2e96442b57e1df850b`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:07.433350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:07.478455 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:07.493756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.495596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:07.569715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1111/2193] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:07.577338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9bb7-ddea-4432-8cba-c2918ddd6703 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.582558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.583575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.584023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.584494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] PATH_INFO: `/v3/projects/d9fb76010b814377bbe46e5962028baf` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.585975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fb76010b814377bbe46e5962028baf)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.588273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.588427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.589575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:07.607153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:07.670740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac189e-bb1e-457a-91a6-c5cb0dccb845 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.689819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fb76010b814377bbe46e5962028baf', 'request_id': 'req-717e7da8-b257-4e6d-bf46-8b46010a084b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:07.708769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fb76010b814377bbe46e5962028baf', 'request_id': 'req-717e7da8-b257-4e6d-bf46-8b46010a084b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:07.715424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fb76010b814377bbe46e5962028baf', 'request_id': 'req-717e7da8-b257-4e6d-bf46-8b46010a084b'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:07.735771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] The token cache is being invalidate because project d9fb76010b814377bbe46e5962028baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:07.736050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:07.738839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:07.746958 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1083/2194] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:07 2022] DELETE /identity/v3/projects/d9fb76010b814377bbe46e5962028baf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:07.750767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:07.753002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:07.773156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.773818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.774100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.774399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.778898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:07.886573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7da8-b257-4e6d-bf46-8b46010a084b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:07.897276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:07.898894 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:07.899261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:07.899618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] PATH_INFO: `/v3/users/068e8c3213ec40d59f17f5ac281e9bf4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:07.905363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=068e8c3213ec40d59f17f5ac281e9bf4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.908416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.917484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:07.919020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:07.940747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1112/2195] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:08.032792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068e8c3213ec40d59f17f5ac281e9bf4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:08.033524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068e8c3213ec40d59f17f5ac281e9bf4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:08.076136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068e8c3213ec40d59f17f5ac281e9bf4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:08.089166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068e8c3213ec40d59f17f5ac281e9bf4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:08.089862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068e8c3213ec40d59f17f5ac281e9bf4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:08.111965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1084/2196] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:07 2022] DELETE /identity/v3/users/068e8c3213ec40d59f17f5ac281e9bf4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:57:08.845056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:08.849450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:08.850772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:08.852698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:08.863992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d77d5-1b26-4331-add3-f6f692bd1947 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:08.876871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:08.910879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:08.945975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:08.947166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:08.947618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:08.948137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] PATH_INFO: `/v3/users/d9ad849326de42ba8d4fbbf72882c427` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:08.949838 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ad849326de42ba8d4fbbf72882c427)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:08.951997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:08.968715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b763-1ea6-4bc3-a576-61121f2f9e3a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:08.974436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:08.975768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:08.976062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:08.976346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] PATH_INFO: `/v3/projects/d9f12361651847e78ad83abc6170b5df` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:08.977680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f12361651847e78ad83abc6170b5df)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:08.979871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:09.050496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ad849326de42ba8d4fbbf72882c427'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.060798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ad849326de42ba8d4fbbf72882c427'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.104210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ad849326de42ba8d4fbbf72882c427'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.108997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ad849326de42ba8d4fbbf72882c427'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.109154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f12361651847e78ad83abc6170b5df', 'request_id': 'req-b293e255-7003-416d-851d-5f61d8f7cdb2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.109703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f514df83-3df5-45ea-8091-db12c2adf2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ad849326de42ba8d4fbbf72882c427'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.135029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f12361651847e78ad83abc6170b5df', 'request_id': 'req-b293e255-7003-416d-851d-5f61d8f7cdb2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.146515 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f12361651847e78ad83abc6170b5df', 'request_id': 'req-b293e255-7003-416d-851d-5f61d8f7cdb2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.152739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1113/2197] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:08 2022] DELETE /identity/v3/users/d9ad849326de42ba8d4fbbf72882c427 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:57:09.157937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591018-9c34-4f0d-813c-c1f1896cfff2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.158403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591018-9c34-4f0d-813c-c1f1896cfff2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.162216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591018-9c34-4f0d-813c-c1f1896cfff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.189077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] The token cache is being invalidate because project d9f12361651847e78ad83abc6170b5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:09.189412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.192466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b293e255-7003-416d-851d-5f61d8f7cdb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:09.195038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1085/2198] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:08 2022] DELETE /identity/v3/projects/d9f12361651847e78ad83abc6170b5df => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:57:09.203559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.204023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.204450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.206187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a4591018-9c34-4f0d-813c-c1f1896cfff2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:09.208274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a4591018-9c34-4f0d-813c-c1f1896cfff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:09.233517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:09.235330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:09.343588 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1114/2199] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:09.352979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1086/2200] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:09.354888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258859f-ae53-4389-b0a8-38858fd50132 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.355339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258859f-ae53-4389-b0a8-38858fd50132 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.355633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258859f-ae53-4389-b0a8-38858fd50132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.358776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:09.360867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:09.382841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c258859f-ae53-4389-b0a8-38858fd50132 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:09.384075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c258859f-ae53-4389-b0a8-38858fd50132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:09.395681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1115/2201] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:09.405402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258859f-ae53-4389-b0a8-38858fd50132 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:09.423570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258859f-ae53-4389-b0a8-38858fd50132 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:09.424170 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:09.432505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:09.433816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.434219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.434591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.435499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a38ed-48e4-4a34-8c25-ae1f0e5e2fbb None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:09.435628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:09.435929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:09.437846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:09.449861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:09.450105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.450399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.450687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.458605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1116/2202] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:57:09.464862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:09.472446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:09.474153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:09.486225 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e2aab-8a99-4609-adba-d4289b52acf2 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:09.488062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1087/2203] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:09.501518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:09.502201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.502488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.502830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.503545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:09.505512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:09.556050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1117/2204] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:09 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:09.557050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:09.586660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd781c-9c99-4a65-afbc-d107c6309c54 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:09.714247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:09.715877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.716321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.716786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.717664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:09.719857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:09.780250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1088/2205] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:09 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:09.781963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:09.795027 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adff73-406c-4cd8-ae15-9ae5bf3d1ef8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:09.806422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:09.807445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.807945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.808464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.810920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:09.828682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:09.838488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:09.857378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1118/2206] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:09.861924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:09.880099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d824f6c-bda0-41f2-842f-7ba52b92df9b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:09.897711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec73663-10f6-484c-9729-8a6f5d727b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:09.899145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73663-10f6-484c-9729-8a6f5d727b6b admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.899437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73663-10f6-484c-9729-8a6f5d727b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.899760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73663-10f6-484c-9729-8a6f5d727b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:09.900633 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec73663-10f6-484c-9729-8a6f5d727b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:09.905282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec73663-10f6-484c-9729-8a6f5d727b6b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:09.926835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1089/2207] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:09.932051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:09.944231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791496d4-e3e3-4b61-b615-66ee54fd9c54 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:09.960959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:09.961887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:09.962174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:09.962456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] PATH_INFO: `/v3/projects/114941a3fa4d41fa819ba98046fbc1d6/users/1372ea59d27448cf8ccba6fa358a6e17/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:10.005658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114941a3fa4d41fa819ba98046fbc1d6, user_id=1372ea59d27448cf8ccba6fa358a6e17, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:10.009058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:10.040140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1119/2208] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:09 2022] PUT /identity/v3/projects/114941a3fa4d41fa819ba98046fbc1d6/users/1372ea59d27448cf8ccba6fa358a6e17/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:10.051663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:10.051663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:10.052061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:10.080062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:10.082217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:10.111077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] MFA Rules not processed for user `1372ea59d27448cf8ccba6fa358a6e17`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:10.117093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:10.268179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a81bc-3272-43ba-9e0a-667d85398cd2 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:10.294543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:10.295448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:10.295843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:10.296358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] PATH_INFO: `/v3/projects/f8bf16292879468b91bf671b7a48ab05` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:10.300036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8bf16292879468b91bf671b7a48ab05)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:10.312237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:10.323550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1090/2209] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:10.331606 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:10.333051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:10.431462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8bf16292879468b91bf671b7a48ab05', 'request_id': 'req-224281a5-02c6-431f-bd91-e078b9feee42'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.444265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8bf16292879468b91bf671b7a48ab05', 'request_id': 'req-224281a5-02c6-431f-bd91-e078b9feee42'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.461056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d3053-4d1b-4943-822b-0e7a7ec159d0 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:10.463908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8bf16292879468b91bf671b7a48ab05', 'request_id': 'req-224281a5-02c6-431f-bd91-e078b9feee42'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.485465 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] The token cache is being invalidate because project f8bf16292879468b91bf671b7a48ab05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:10.486271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.489340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.495495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1120/2210] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:10 2022] DELETE /identity/v3/projects/f8bf16292879468b91bf671b7a48ab05 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:10.496768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:10.497318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:10.500440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:10.587614 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:10.588297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:10.588600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:10.589035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:10.593121 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:10.625866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224281a5-02c6-431f-bd91-e078b9feee42 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:10.642384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:10.643280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:10.643570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:10.643855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] PATH_INFO: `/v3/users/3d08606d61a74c2e96442b57e1df850b` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:10.645139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d08606d61a74c2e96442b57e1df850b)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:10.647377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:10.659117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:10.730951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:10.732452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:10.756613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d08606d61a74c2e96442b57e1df850b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.771152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1091/2211] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:10.777011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d08606d61a74c2e96442b57e1df850b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.795114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d08606d61a74c2e96442b57e1df850b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.797499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d08606d61a74c2e96442b57e1df850b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.798553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-16f1387d-2243-4a7d-99a8-691d69ba9b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d08606d61a74c2e96442b57e1df850b'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:10.823107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1121/2212] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:10 2022] DELETE /identity/v3/users/3d08606d61a74c2e96442b57e1df850b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:11.519253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:11.541435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b10d-dce0-41d3-8958-95c6b4e6ce90 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:11.688626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:11.689545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:11.689834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:11.690113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] PATH_INFO: `/v3/projects/9f937b55dc74497ea03170c2f8eda32f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:11.698613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f937b55dc74497ea03170c2f8eda32f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:11.706909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:11.811852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f937b55dc74497ea03170c2f8eda32f', 'request_id': 'req-b2f3e97e-083d-4b0e-9b7d-761607343015'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:11.834342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f937b55dc74497ea03170c2f8eda32f', 'request_id': 'req-b2f3e97e-083d-4b0e-9b7d-761607343015'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:11.842508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f937b55dc74497ea03170c2f8eda32f', 'request_id': 'req-b2f3e97e-083d-4b0e-9b7d-761607343015'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:11.854483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:11.859811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] The token cache is being invalidate because project 9f937b55dc74497ea03170c2f8eda32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:11.860501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:11.862122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b2f3e97e-083d-4b0e-9b7d-761607343015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:11.865021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1092/2213] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:11 2022] DELETE /identity/v3/projects/9f937b55dc74497ea03170c2f8eda32f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:11.870187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf3383-8f32-4142-8cec-fad66ede9c13 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:11.870662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf3383-8f32-4142-8cec-fad66ede9c13 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:11.870740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf3383-8f32-4142-8cec-fad66ede9c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:11.896014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-dddf3383-8f32-4142-8cec-fad66ede9c13 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:11.897203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-dddf3383-8f32-4142-8cec-fad66ede9c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:11.969781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1122/2214] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:11.977756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55dea-6421-4f04-bc56-e05204367c34 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:11.978050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55dea-6421-4f04-bc56-e05204367c34 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:11.978337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55dea-6421-4f04-bc56-e05204367c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.021047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-93a55dea-6421-4f04-bc56-e05204367c34 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:12.024795 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-93a55dea-6421-4f04-bc56-e05204367c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:12.037058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1093/2215] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:12.041590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf3383-8f32-4142-8cec-fad66ede9c13 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.053360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf3383-8f32-4142-8cec-fad66ede9c13 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:12.059848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:12.060777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.061142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.061508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.062845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:12.063238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:12.065481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:12.087402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1123/2216] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:57:12.089266 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55dea-6421-4f04-bc56-e05204367c34 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.105060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55dea-6421-4f04-bc56-e05204367c34 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:12.111340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:12.112256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.112544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.112861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.113615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:12.116150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:12.149376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1094/2217] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:12 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:12.152429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.163862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b8f2-8e2c-4d84-b1ee-1ceddc32e2e1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:12.299307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:12.300489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.301418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.317986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.319581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:12.321756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:12.367096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:12.389208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1124/2218] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:12 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:12.394991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.417937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec6b9-158f-4312-8cb0-a222f15e7677 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:12.443867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:12.444700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.445040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.445449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.446275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:12.448058 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:12.468569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1095/2219] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:57:12.470058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.485553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5b23-9022-460f-b50f-869656aada35 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:12.499493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860f880-263d-4658-b911-462be2cf8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:12.500165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f880-263d-4658-b911-462be2cf8571 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.500451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f880-263d-4658-b911-462be2cf8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.500768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f880-263d-4658-b911-462be2cf8571 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.502018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860f880-263d-4658-b911-462be2cf8571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:12.503573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860f880-263d-4658-b911-462be2cf8571 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:12.532839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1125/2220] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:12.536401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.559348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c5a77-f359-491d-b27e-1bbd2f1b436c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:12.570493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80be9a8-6125-4d51-82d0-ebfdbea14f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:12.571597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80be9a8-6125-4d51-82d0-ebfdbea14f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.571978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80be9a8-6125-4d51-82d0-ebfdbea14f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.572357 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80be9a8-6125-4d51-82d0-ebfdbea14f5b admin admin] PATH_INFO: `/v3/projects/b2b84d47b94b4e9099e18fd26aa97739/users/eb96f436fba94e40835cd8c4bb3df8c4/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.593410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80be9a8-6125-4d51-82d0-ebfdbea14f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b84d47b94b4e9099e18fd26aa97739, user_id=eb96f436fba94e40835cd8c4bb3df8c4, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:12.597363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80be9a8-6125-4d51-82d0-ebfdbea14f5b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:12.635241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1096/2221] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:12 2022] PUT /identity/v3/projects/b2b84d47b94b4e9099e18fd26aa97739/users/eb96f436fba94e40835cd8c4bb3df8c4/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:12.640056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.640740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.641257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.674410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:12.676067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:12.784088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.784389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.784714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.807130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1126/2222] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:12.816618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.818303 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:12.823766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] MFA Rules not processed for user `88c71f6ddf364c9baca69e459547ab02`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:12.825646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:12.913682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99878e-6e7b-4ee6-a1c1-93d776e2db96 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:12.918266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2d6b1-f0cd-4e1d-8a7f-9474010676f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:12.919239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2d6b1-f0cd-4e1d-8a7f-9474010676f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:12.919528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2d6b1-f0cd-4e1d-8a7f-9474010676f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:12.920628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2d6b1-f0cd-4e1d-8a7f-9474010676f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:12.933416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2d6b1-f0cd-4e1d-8a7f-9474010676f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:12.934975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2d6b1-f0cd-4e1d-8a7f-9474010676f8 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:12.942653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1097/2223] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:12.951423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:12.955828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1127/2224] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:12.957724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:13.104744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067dd37-79f5-4a09-a269-369006c28491 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:13.113581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:13.116136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:13.116531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:13.116966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:13.127133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:13.129166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:13.142560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1098/2225] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:13.898534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb249c-4db3-4dfe-8969-ca6d8bb363d7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:13.899158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb249c-4db3-4dfe-8969-ca6d8bb363d7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:13.899363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb249c-4db3-4dfe-8969-ca6d8bb363d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:13.939812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-51eb249c-4db3-4dfe-8969-ca6d8bb363d7 None None] MFA Rules not processed for user `eb96f436fba94e40835cd8c4bb3df8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:13.947497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-51eb249c-4db3-4dfe-8969-ca6d8bb363d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:14.038378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1128/2226] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:14.043866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.060168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d432e68-34f7-4f17-a350-dfbfe7a08e99 service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:14.066149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:14.066838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.067124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.067422 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.068099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:14.070116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:14.075412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:14.124362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb249c-4db3-4dfe-8969-ca6d8bb363d7 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.126590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1099/2227] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:14 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:14.137285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb249c-4db3-4dfe-8969-ca6d8bb363d7 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:14.161119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:14.215019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:14.215832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.216664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.217107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.217979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:14.219904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:14.243464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1129/2228] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:14 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:14.247607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.259944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77819c2-4221-4353-9c16-5cb8f22885aa admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:14.264802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:14.265510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.265772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.266055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.266961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:14.268659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:14.283188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1100/2229] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:57:14.284981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.296394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95e0b-f2ed-47a3-827a-3507617ee150 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:14.301450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:14.302341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.302670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.303575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] PATH_INFO: `/v3/projects/23c3ad7d5f2547ab8551f78c3184671f/users/9919c254447348a8b14cd4ac1ce033cc/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.323678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c3ad7d5f2547ab8551f78c3184671f, user_id=9919c254447348a8b14cd4ac1ce033cc, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:14.326396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:14.346212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1130/2230] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:14 2022] PUT /identity/v3/projects/23c3ad7d5f2547ab8551f78c3184671f/users/9919c254447348a8b14cd4ac1ce033cc/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:14.347626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.371900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6777-ca4b-43e9-b024-5d4acd59d469 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:14.460398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:14.461048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.461298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.461580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.462323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:14.464952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:14.471472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.473484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:14.495540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975747-e182-49b0-9a27-fa2043d9417a admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:14.500561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1101/2231] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:14.502840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.512139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:14.513066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.513631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.514008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] PATH_INFO: `/v3/users/1372ea59d27448cf8ccba6fa358a6e17` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.515575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1372ea59d27448cf8ccba6fa358a6e17)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:14.520142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:14.526124 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ac372-1d03-4380-a76d-ba25be44fe10 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:14.543087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ae079-2030-4d4f-8a20-76dcd0986f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:14.544015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae079-2030-4d4f-8a20-76dcd0986f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.544301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae079-2030-4d4f-8a20-76dcd0986f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.544599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae079-2030-4d4f-8a20-76dcd0986f9e admin admin] PATH_INFO: `/v3/projects/23c3ad7d5f2547ab8551f78c3184671f/users/9919c254447348a8b14cd4ac1ce033cc/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.550069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ae079-2030-4d4f-8a20-76dcd0986f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c3ad7d5f2547ab8551f78c3184671f, user_id=9919c254447348a8b14cd4ac1ce033cc, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:14.553597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ae079-2030-4d4f-8a20-76dcd0986f9e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:14.570956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1102/2232] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:14 2022] PUT /identity/v3/projects/23c3ad7d5f2547ab8551f78c3184671f/users/9919c254447348a8b14cd4ac1ce033cc/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:14.607748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1372ea59d27448cf8ccba6fa358a6e17'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:14.616004 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1372ea59d27448cf8ccba6fa358a6e17'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:14.645346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1372ea59d27448cf8ccba6fa358a6e17'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:14.646334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1372ea59d27448cf8ccba6fa358a6e17'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:14.647791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1372ea59d27448cf8ccba6fa358a6e17'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:14.670600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1131/2233] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:14 2022] DELETE /identity/v3/users/1372ea59d27448cf8ccba6fa358a6e17 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:14.675904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:14.676681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:14.676974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:14.703827 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:14.705811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:14.784382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1103/2234] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:14.937220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:14.940978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:15.050145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824b0e-d985-4b6a-ac88-246a6f02c074 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:15.056625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94800878-67bc-4d8d-b56c-82c41fb4bc6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:15.057398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800878-67bc-4d8d-b56c-82c41fb4bc6f service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:15.057883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800878-67bc-4d8d-b56c-82c41fb4bc6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:15.058522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94800878-67bc-4d8d-b56c-82c41fb4bc6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:15.073561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94800878-67bc-4d8d-b56c-82c41fb4bc6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:15.077235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94800878-67bc-4d8d-b56c-82c41fb4bc6f service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:15.093641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1132/2235] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:16.002393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:16.003867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:16.016254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc6f45-0ac8-4fc0-8ecc-7e60a9dec799 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:16.023110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:16.024326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.024717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.025161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] PATH_INFO: `/v3/projects/114941a3fa4d41fa819ba98046fbc1d6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.027580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114941a3fa4d41fa819ba98046fbc1d6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:16.030010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:16.095841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114941a3fa4d41fa819ba98046fbc1d6', 'request_id': 'req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:16.101049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:16.107895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114941a3fa4d41fa819ba98046fbc1d6', 'request_id': 'req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:16.119176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114941a3fa4d41fa819ba98046fbc1d6', 'request_id': 'req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:16.136210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] The token cache is being invalidate because project 114941a3fa4d41fa819ba98046fbc1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:16.136676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:16.137532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ca9fd8a9-c402-43d5-b5a0-ea005f8b9fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:16.139143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1104/2236] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:16 2022] DELETE /identity/v3/projects/114941a3fa4d41fa819ba98046fbc1d6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:16.144174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2c26-6612-4246-9db3-c29b5da5df1b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.145092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2c26-6612-4246-9db3-c29b5da5df1b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.145817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2c26-6612-4246-9db3-c29b5da5df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.154987 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:16.200951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-89bd2c26-6612-4246-9db3-c29b5da5df1b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:16.202371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-89bd2c26-6612-4246-9db3-c29b5da5df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:16.224901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0054-4110-49fc-a2e3-b875d9cc867e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.225372 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0054-4110-49fc-a2e3-b875d9cc867e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.225802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0054-4110-49fc-a2e3-b875d9cc867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.260944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-80da0054-4110-49fc-a2e3-b875d9cc867e None None] MFA Rules not processed for user `9919c254447348a8b14cd4ac1ce033cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:16.262365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-80da0054-4110-49fc-a2e3-b875d9cc867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:16.326117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1133/2237] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:16.339931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2b51-ed88-42ee-b826-eff22c537fa5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.339931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2b51-ed88-42ee-b826-eff22c537fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.340197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e2b51-ed88-42ee-b826-eff22c537fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.362463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-687e2b51-ed88-42ee-b826-eff22c537fa5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:16.363914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-687e2b51-ed88-42ee-b826-eff22c537fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:16.383329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1134/2238] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:16.387553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2b51-ed88-42ee-b826-eff22c537fa5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:16.411039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e2b51-ed88-42ee-b826-eff22c537fa5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:16.424240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1105/2239] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:16.424240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702b135-d50d-4d8a-b789-b3e38bade55c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.424240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702b135-d50d-4d8a-b789-b3e38bade55c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.424240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702b135-d50d-4d8a-b789-b3e38bade55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.428909 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:16.430077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.430681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.431114 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.432012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:16.432495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:16.434289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:16.458345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1702b135-d50d-4d8a-b789-b3e38bade55c None None] MFA Rules not processed for user `88c71f6ddf364c9baca69e459547ab02`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:16.460325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1702b135-d50d-4d8a-b789-b3e38bade55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:16.461071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1135/2240] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:57:16.462170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:16.464164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:16.548383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412737-c00f-42ef-af08-09ff54e3f879 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:16.567497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:16.568227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.569038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.569499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.571204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:16.591889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1106/2241] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:16.593386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702b135-d50d-4d8a-b789-b3e38bade55c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:16.622203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702b135-d50d-4d8a-b789-b3e38bade55c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:16.635291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:16.635988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.636274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.636559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.637417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:16.639386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:16.690194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1107/2242] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:16 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:16.695483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:16.718674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:16.720514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:16.733258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1136/2243] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:16.825173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:16.849093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ab9a-846b-43f9-893d-0b881b7edde2 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:16.859571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:16.859571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.859571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.859571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.860321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:16.885799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:16.935255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1108/2244] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:16 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:16.935965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:16.965968 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07d97-81a2-4e7b-a7e5-fdb804c05633 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:16.971793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:16.976008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:16.976395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:16.976781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:16.978313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:16.980236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.005554 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1137/2245] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:17.009897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:17.030479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e24c6-0fe7-4227-a10d-7d939831a061 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:17.040098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784e79b-59bc-495f-9489-496dd2cc11c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:17.040934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784e79b-59bc-495f-9489-496dd2cc11c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.041292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784e79b-59bc-495f-9489-496dd2cc11c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.041526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784e79b-59bc-495f-9489-496dd2cc11c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.042425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784e79b-59bc-495f-9489-496dd2cc11c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:17.044566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784e79b-59bc-495f-9489-496dd2cc11c8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.061524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1109/2246] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:17.067577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:17.081069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ef9a7-dd0f-4d2a-80f7-0408d6e01d43 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:17.088982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:17.090323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.090794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.091254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] PATH_INFO: `/v3/projects/1e399148cde14317a3aa2ffe6bb569b2/users/7c4706cef8a94d74bc0a7d4bf9084d98/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.111804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e399148cde14317a3aa2ffe6bb569b2, user_id=7c4706cef8a94d74bc0a7d4bf9084d98, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:17.118681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.144634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1138/2247] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:17 2022] PUT /identity/v3/projects/1e399148cde14317a3aa2ffe6bb569b2/users/7c4706cef8a94d74bc0a7d4bf9084d98/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:17.154092 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3022-86fe-44a8-bc37-d6cb8ede2f1f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.154587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3022-86fe-44a8-bc37-d6cb8ede2f1f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.155084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3022-86fe-44a8-bc37-d6cb8ede2f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.222286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-fecb3022-86fe-44a8-bc37-d6cb8ede2f1f None None] MFA Rules not processed for user `7c4706cef8a94d74bc0a7d4bf9084d98`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:17.223810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-fecb3022-86fe-44a8-bc37-d6cb8ede2f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:17.316866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1110/2248] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:17.322003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:17.328476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:17.414488 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabea3e1-faa7-445f-8d73-a3ecd2de43fa admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:17.422082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:17.423176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.423176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.423618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.424507 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:17.426889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.470432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1139/2249] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:17 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:17.471652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3022-86fe-44a8-bc37-d6cb8ede2f1f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:17.483823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3022-86fe-44a8-bc37-d6cb8ede2f1f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:17.573431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:17.574310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.575314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.575582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.577101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:17.580433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.616226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1111/2250] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:17 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:17.617935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:17.632759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52706c8d-3c74-45e1-837d-0e75c684659b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:17.649494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:17.650335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.650711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.651108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.652302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:17.654343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.673013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1140/2251] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:17.674789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:17.687227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60a7e-9bbd-43a7-b348-10b7ec349852 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:17.692486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc24ac-93b9-4e9e-ae45-d94f7e943302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:17.693274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc24ac-93b9-4e9e-ae45-d94f7e943302 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.693571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc24ac-93b9-4e9e-ae45-d94f7e943302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.693949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc24ac-93b9-4e9e-ae45-d94f7e943302 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.694883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc24ac-93b9-4e9e-ae45-d94f7e943302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:17.696454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc24ac-93b9-4e9e-ae45-d94f7e943302 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.712977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1112/2252] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:17.714146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:17.726681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cf1d8-632e-455e-a025-3d4a0ed395dd admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:17.732441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:17.733462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.733751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.734035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] PATH_INFO: `/v3/projects/26be8c366d8c4ad782ce11946e33fc0b/users/3a3e1b6dc55a4b87b8caebb27fd721cb/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.751560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26be8c366d8c4ad782ce11946e33fc0b, user_id=3a3e1b6dc55a4b87b8caebb27fd721cb, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:17.759692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:17.779294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1141/2253] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:17 2022] PUT /identity/v3/projects/26be8c366d8c4ad782ce11946e33fc0b/users/3a3e1b6dc55a4b87b8caebb27fd721cb/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:17.791538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e18b93-48ae-40ff-83ec-8c9c891ac490 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:17.791811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e18b93-48ae-40ff-83ec-8c9c891ac490 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:17.792162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e18b93-48ae-40ff-83ec-8c9c891ac490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:17.838937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d6e18b93-48ae-40ff-83ec-8c9c891ac490 None None] MFA Rules not processed for user `3a3e1b6dc55a4b87b8caebb27fd721cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:17.840458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d6e18b93-48ae-40ff-83ec-8c9c891ac490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:17.892514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:17.984729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1113/2254] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:17.988911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:18.083582 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5607-51bf-4a01-b826-93462e7494e8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:18.091351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:18.092221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.092816 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.103662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.106024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:18.108427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:18.156163 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1142/2255] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:17 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:18.157437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e18b93-48ae-40ff-83ec-8c9c891ac490 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:18.174148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e18b93-48ae-40ff-83ec-8c9c891ac490 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:18.340022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:18.340871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.341327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.341618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.342319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:18.344457 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:18.375365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1114/2256] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:18 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:18.376746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:18.389133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e241c5-02f3-432c-be2b-d4c6120b6ceb admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:18.400140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:18.400908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.401242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.401614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.402378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:18.404338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:18.420380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1143/2257] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:18.424563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:18.439310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4420c6-9396-41d7-8db1-7fe433a67bc3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:18.445653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:18.446608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.446908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.447190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] PATH_INFO: `/v3/projects/f6cac6389eaa4bd584445f81ba8f13ca/users/87f6997f14934c31b2186e9a329169f8/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.463712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cac6389eaa4bd584445f81ba8f13ca, user_id=87f6997f14934c31b2186e9a329169f8, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:18.466453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:18.479509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1115/2258] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:18 2022] PUT /identity/v3/projects/f6cac6389eaa4bd584445f81ba8f13ca/users/87f6997f14934c31b2186e9a329169f8/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:18.483477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:18.493654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4eb1-d526-403b-970e-8bbc0d6774e7 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:18.519065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:18.553092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e8634-644a-4716-a51d-b0fd05ddc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:18.553801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8634-644a-4716-a51d-b0fd05ddc64a admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.554119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8634-644a-4716-a51d-b0fd05ddc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.554400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8634-644a-4716-a51d-b0fd05ddc64a admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.555129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e8634-644a-4716-a51d-b0fd05ddc64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:18.556780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e8634-644a-4716-a51d-b0fd05ddc64a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:18.566880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1144/2259] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:18.571505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:18.581707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d0a2b-d70a-4b04-b5b8-f2c807ac0ce7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:18.587208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:18.588108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.588398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.588719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] PATH_INFO: `/v3/projects/f6cac6389eaa4bd584445f81ba8f13ca/users/87f6997f14934c31b2186e9a329169f8/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.590714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cac6389eaa4bd584445f81ba8f13ca, user_id=87f6997f14934c31b2186e9a329169f8, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:18.593421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:18.604016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1116/2260] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:18 2022] PUT /identity/v3/projects/f6cac6389eaa4bd584445f81ba8f13ca/users/87f6997f14934c31b2186e9a329169f8/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:18.614082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615cf6f-6d30-4479-8438-83e9e3ed796f None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.614379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615cf6f-6d30-4479-8438-83e9e3ed796f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.614663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615cf6f-6d30-4479-8438-83e9e3ed796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.640811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b615cf6f-6d30-4479-8438-83e9e3ed796f None None] MFA Rules not processed for user `87f6997f14934c31b2186e9a329169f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:18.642041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b615cf6f-6d30-4479-8438-83e9e3ed796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:18.708323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1145/2261] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:18.719858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:18.773702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696135d2-a4f9-4ced-a296-33eb187adbbe admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:18.777438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:18.778069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:18.778358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:18.778640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:18.810656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:18.835363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:18.836837 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:18.845541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1117/2262] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:20.462544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615cf6f-6d30-4479-8438-83e9e3ed796f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:20.472858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615cf6f-6d30-4479-8438-83e9e3ed796f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:20.477837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501db9b6-625c-467e-b6da-07ece747c439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:20.478343 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501db9b6-625c-467e-b6da-07ece747c439 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:20.478613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501db9b6-625c-467e-b6da-07ece747c439 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:20.478897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501db9b6-625c-467e-b6da-07ece747c439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:20.543747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501db9b6-625c-467e-b6da-07ece747c439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:20.545225 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501db9b6-625c-467e-b6da-07ece747c439 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:20.554899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1146/2263] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:21.460835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:21.469915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9769-c1f4-4f00-90f2-127eae77374f service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:21.487012 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:21.487702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:21.488006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:21.488269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:21.547748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:21.548711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:21.549009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:21.559097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:21.560611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:21.570582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1118/2264] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:21.571472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:21.573052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:21.621423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:21.642936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1147/2265] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:21.711419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:21.712912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:21.805211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413091-a396-4d00-b2fb-6f4d200e3171 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:21.811292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4c452-fb1d-42b8-8317-69c1fe24bdd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:21.812109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c452-fb1d-42b8-8317-69c1fe24bdd8 service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:21.812466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c452-fb1d-42b8-8317-69c1fe24bdd8 service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:21.813029 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c452-fb1d-42b8-8317-69c1fe24bdd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:21.825306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c452-fb1d-42b8-8317-69c1fe24bdd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:21.827496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c452-fb1d-42b8-8317-69c1fe24bdd8 service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:21.843309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1119/2266] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:57:22.608613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:22.610127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:22.626192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc784d-24f9-4023-b0f7-0c06f0e8f3be None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:22.630301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:22.631562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:22.631853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:22.632133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:22.643929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:22.645510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:22.657064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1148/2267] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:22.757694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6746b-0186-4904-91e9-a6d68a6df391 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:22.758621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6746b-0186-4904-91e9-a6d68a6df391 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:22.758914 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6746b-0186-4904-91e9-a6d68a6df391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:22.778105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-76b6746b-0186-4904-91e9-a6d68a6df391 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:22.779328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-76b6746b-0186-4904-91e9-a6d68a6df391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:22.787303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1120/2268] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 18 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:22.800453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:22.812327 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6fc8d-2e91-4a18-8d78-9cc3e99a449a service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:22.817400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:22.818107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:22.818963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:22.819244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:22.828007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:22.829613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:22.838088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1149/2269] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:57:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:57:23.082982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2007b-3c20-4947-873c-40aa7beb70c1 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:23.083276 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2007b-3c20-4947-873c-40aa7beb70c1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:23.083740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2007b-3c20-4947-873c-40aa7beb70c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:23.104752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-64d2007b-3c20-4947-873c-40aa7beb70c1 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:23.106064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-64d2007b-3c20-4947-873c-40aa7beb70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:23.113719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1121/2270] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:23.126750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:23.137705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52748-998d-4b52-b485-fbd8d3ea7998 service swift] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:23.142977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:23.143639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:23.143927 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:23.144467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:23.153612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:23.155267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:23.166065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1150/2271] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:57:23.549392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:23.550103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:23.550103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:23.569011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:23.570228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:23.578654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1122/2272] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 18 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:23.591604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:23.607881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00009bd5-abd9-41a0-8c72-d7501e9f6fc6 service swift] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:23.609747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:23.610471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:23.611111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:23.611466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:23.624867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:23.627744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:23.637232 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1151/2273] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:57:26.045890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:26.047305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:26.095888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:26.098599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:26.101252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:26.120026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d80b08-9986-499e-9d7b-6778b6af8567 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:26.125128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:26.126020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.126340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.126726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] PATH_INFO: `/v3/users/171a776a46b74b78aeded3ceee42647a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.128464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=171a776a46b74b78aeded3ceee42647a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:26.130669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:26.177445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef6fa5-7c1f-402a-a4fa-eb2d2123526c service swift] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:26.184346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:26.185599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.186101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.186590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] PATH_INFO: `/v3/users/03d917013dd04146a3f7604b4856d63e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.188295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d917013dd04146a3f7604b4856d63e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:26.193366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:26.204193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171a776a46b74b78aeded3ceee42647a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.205232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171a776a46b74b78aeded3ceee42647a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.221016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171a776a46b74b78aeded3ceee42647a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.231779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171a776a46b74b78aeded3ceee42647a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.232980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-39012de3-6bb6-4a9a-963c-247772082d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171a776a46b74b78aeded3ceee42647a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.248456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1123/2274] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:26 2022] DELETE /identity/v3/users/171a776a46b74b78aeded3ceee42647a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:26.252519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.252844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.253126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.265220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d917013dd04146a3f7604b4856d63e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.272481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:26.273734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:26.275145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d917013dd04146a3f7604b4856d63e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.290254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d917013dd04146a3f7604b4856d63e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.291009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d917013dd04146a3f7604b4856d63e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.291633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ac10371a-3f82-440d-a732-a6341ed52889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d917013dd04146a3f7604b4856d63e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.311411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1152/2275] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:26 2022] DELETE /identity/v3/users/03d917013dd04146a3f7604b4856d63e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:26.319129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.319129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.319357 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.337600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:26.338805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:26.345128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1124/2276] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:26.349210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:26.359166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:26.360846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:26.432710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1153/2277] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:57:26.458453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:26.464325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:26.473475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078f59e-e2b8-4935-bd34-cba82e5ba672 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:26.499260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:26.563205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ade44-a1c9-405b-bde9-f941c42a4ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:26.564184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ade44-a1c9-405b-bde9-f941c42a4ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.564685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ade44-a1c9-405b-bde9-f941c42a4ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.565625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ade44-a1c9-405b-bde9-f941c42a4ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.579049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279436d-38a7-44f2-b201-4ccdbe9b440b None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:26.585648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:26.589422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.589422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.589422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.609797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:26.612781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:26.621885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ade44-a1c9-405b-bde9-f941c42a4ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:26.623367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ade44-a1c9-405b-bde9-f941c42a4ea8 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:26.680722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1154/2278] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:26.688773 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1125/2279] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:26.773476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:26.774820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:26.804401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c9269-b009-4891-99e4-600ab34a2dc0 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:26.809891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:26.811077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.811452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.811794 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] PATH_INFO: `/v3/users/7c4706cef8a94d74bc0a7d4bf9084d98` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.813118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4706cef8a94d74bc0a7d4bf9084d98)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:26.815789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:26.891892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4706cef8a94d74bc0a7d4bf9084d98'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.902771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4706cef8a94d74bc0a7d4bf9084d98'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.913350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:26.923598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4706cef8a94d74bc0a7d4bf9084d98'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.924526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4706cef8a94d74bc0a7d4bf9084d98'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.926147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4706cef8a94d74bc0a7d4bf9084d98'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:26.945529 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1155/2280] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:26 2022] DELETE /identity/v3/users/7c4706cef8a94d74bc0a7d4bf9084d98 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:26.950026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:26.950501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:26.950797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:26.992658 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:26.994320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.010682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:27.012253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.099881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1126/2281] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:27.099881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.099881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.106376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8668aef-b165-442f-a774-90f57607ad67 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.111697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.112771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.113061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.114094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] PATH_INFO: `/v3/projects/aa47aeea058d4846a17e07d8d116984a` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.116387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa47aeea058d4846a17e07d8d116984a)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.118843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.120957 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d218b-b485-4eeb-9a4e-558813721cd9 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.126088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.127085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.127368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.127653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] PATH_INFO: `/v3/projects/daae77ba94fc4aa7b632002da6304ceb` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.129116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daae77ba94fc4aa7b632002da6304ceb)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.131759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.186901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa47aeea058d4846a17e07d8d116984a', 'request_id': 'req-60fecde2-0121-4e74-b0a9-7c8411103be0'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.199194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa47aeea058d4846a17e07d8d116984a', 'request_id': 'req-60fecde2-0121-4e74-b0a9-7c8411103be0'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.201302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daae77ba94fc4aa7b632002da6304ceb', 'request_id': 'req-846448e7-9091-454b-bcc8-586d5c2b3476'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.212553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daae77ba94fc4aa7b632002da6304ceb', 'request_id': 'req-846448e7-9091-454b-bcc8-586d5c2b3476'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.215026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa47aeea058d4846a17e07d8d116984a', 'request_id': 'req-60fecde2-0121-4e74-b0a9-7c8411103be0'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.220004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daae77ba94fc4aa7b632002da6304ceb', 'request_id': 'req-846448e7-9091-454b-bcc8-586d5c2b3476'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.226978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] The token cache is being invalidate because project aa47aeea058d4846a17e07d8d116984a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:27.227272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.227596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:27.228652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.230285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1156/2282] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:26 2022] DELETE /identity/v3/projects/aa47aeea058d4846a17e07d8d116984a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:57:27.231203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.232539 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] The token cache is being invalidate because project daae77ba94fc4aa7b632002da6304ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:27.232884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.232995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.233646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-846448e7-9091-454b-bcc8-586d5c2b3476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.235459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1127/2283] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:27 2022] DELETE /identity/v3/projects/daae77ba94fc4aa7b632002da6304ceb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:27.236906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ca3d-6dd6-433a-8063-e92023a562e4 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.237875 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ca3d-6dd6-433a-8063-e92023a562e4 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.238115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ca3d-6dd6-433a-8063-e92023a562e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.278590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-abb3ca3d-6dd6-433a-8063-e92023a562e4 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:27.279700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-abb3ca3d-6dd6-433a-8063-e92023a562e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.315949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:27.335310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecde2-0121-4e74-b0a9-7c8411103be0 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.345170 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1128/2284] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:27.354024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc589db-2e19-4d02-80e2-6a506bc7c73b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.354318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc589db-2e19-4d02-80e2-6a506bc7c73b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.354619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc589db-2e19-4d02-80e2-6a506bc7c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.373426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-4fc589db-2e19-4d02-80e2-6a506bc7c73b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:27.374647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4fc589db-2e19-4d02-80e2-6a506bc7c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.383016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1129/2285] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:27.384273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcdd26-084c-4ca5-acb5-35b9506d521e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.384564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcdd26-084c-4ca5-acb5-35b9506d521e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.384877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcdd26-084c-4ca5-acb5-35b9506d521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.398688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.399508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.399797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.400100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.401960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.407173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-00bcdd26-084c-4ca5-acb5-35b9506d521e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:27.408330 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-00bcdd26-084c-4ca5-acb5-35b9506d521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.418304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1130/2286] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:27.420973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.422417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.422556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccfa6a-d155-4a24-aafd-6ccaf53deaa7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.422847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccfa6a-d155-4a24-aafd-6ccaf53deaa7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.423165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccfa6a-d155-4a24-aafd-6ccaf53deaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.434139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1157/2287] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:27.434979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.442317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9eccfa6a-d155-4a24-aafd-6ccaf53deaa7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:27.443714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9eccfa6a-d155-4a24-aafd-6ccaf53deaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.444860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb4af-3948-47ee-a145-66d674242336 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.450406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.451069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.451350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.451630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.452473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:27.452835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.454445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.457524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1131/2288] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:27.462123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccfa6a-d155-4a24-aafd-6ccaf53deaa7 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.477352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1158/2289] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:57:27.478602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccfa6a-d155-4a24-aafd-6ccaf53deaa7 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.478914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.489462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e2ce2-73f3-4b21-a4ab-9e12678112e8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.491608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.492494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.492902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.493981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.495114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:27.495355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.495472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.496014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.496300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.496604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.497192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.497289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.499173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.512623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1132/2290] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:57:27.514524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.526851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a246-26df-446c-b139-ca80e6bc4450 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.531982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.532712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.532982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.533420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.534319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.535913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1159/2291] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:27.536468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.537481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.575406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1133/2292] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:27.576642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.608389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c651a2-4bf3-4028-94f9-b3e9a11b567e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.652433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ac9e-3462-4762-82ef-fdaa464b03d5 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.659782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.660551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.661286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.661641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.663832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.665501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.683066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.683862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.684292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.684644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.685320 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.693531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1134/2293] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:27.695390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.696818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.709872 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e0188-1022-4742-b265-3144ab0cd898 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.723681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.724435 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.725232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.725534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.726292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.731317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.744398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1135/2294] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:27.745304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:27.753234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1160/2295] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:27 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:27.753740 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.759082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.778381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfefb28-c0a5-43c3-9fa9-f34e3af4e18b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.782681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9419193-da9f-4bfc-aa8d-00f3c186bbad admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.788522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.789225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.789511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.789791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.790510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.792411 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.794346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:27.798358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.798358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.798559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.798741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.799471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.801433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.813557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1161/2296] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:27.814440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.816203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.831884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002df5a1-1c82-4bbe-8337-d9cee48552ea admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.837377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.838349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.838639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.838922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] PATH_INFO: `/v3/projects/1e399148cde14317a3aa2ffe6bb569b2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.840137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e399148cde14317a3aa2ffe6bb569b2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.842093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.844562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1136/2297] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:27.845721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.858335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969dd8c-8d7f-43a1-a1ee-daa6585ba69c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.866822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.867820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.868247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.868737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.869886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.872138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:27.889298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1137/2298] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:27.889298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.901753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876c39-b191-4bd1-bbca-e545495ce623 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:27.911447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e399148cde14317a3aa2ffe6bb569b2', 'request_id': 'req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.918394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e399148cde14317a3aa2ffe6bb569b2', 'request_id': 'req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.926734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e399148cde14317a3aa2ffe6bb569b2', 'request_id': 'req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.945566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] The token cache is being invalidate because project 1e399148cde14317a3aa2ffe6bb569b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:27.945861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.946755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:27.949336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1162/2299] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:27 2022] DELETE /identity/v3/projects/1e399148cde14317a3aa2ffe6bb569b2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:27.950106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:27.951543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:27.966685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:27.967587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:27.967868 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:27.968150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] PATH_INFO: `/v3/projects/379bba80af244096abbf8deb82772854/users/c9a0569d0a7641a9858c0810219b1ef8/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:27.985923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379bba80af244096abbf8deb82772854, user_id=c9a0569d0a7641a9858c0810219b1ef8, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:27.988685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:28.009829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1138/2300] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:27 2022] PUT /identity/v3/projects/379bba80af244096abbf8deb82772854/users/c9a0569d0a7641a9858c0810219b1ef8/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:28.010824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:28.014163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.065804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd75c61-b2e4-4554-8f14-eddbc6e759b6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:28.097609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f995c13-5343-44a7-8e2e-04740c21ff29 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:28.102464 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:28.103355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.103668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.103915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] PATH_INFO: `/v3/users/3a3e1b6dc55a4b87b8caebb27fd721cb` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.105272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3e1b6dc55a4b87b8caebb27fd721cb)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:28.107251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:28.129947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e06516-7cfc-4c1f-a386-86c50eb39985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:28.131637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e06516-7cfc-4c1f-a386-86c50eb39985 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.131986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e06516-7cfc-4c1f-a386-86c50eb39985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.132336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e06516-7cfc-4c1f-a386-86c50eb39985 admin admin] PATH_INFO: `/v3/projects/2ca8263773da4d3ca157704d94175d48/users/62f4b13b288a455cba839e4c5d651f16/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.149328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e06516-7cfc-4c1f-a386-86c50eb39985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8263773da4d3ca157704d94175d48, user_id=62f4b13b288a455cba839e4c5d651f16, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:28.152870 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e06516-7cfc-4c1f-a386-86c50eb39985 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:28.152991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3e1b6dc55a4b87b8caebb27fd721cb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.153647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3e1b6dc55a4b87b8caebb27fd721cb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.162555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:28.167100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3e1b6dc55a4b87b8caebb27fd721cb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.168397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1163/2301] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:27 2022] PUT /identity/v3/projects/2ca8263773da4d3ca157704d94175d48/users/62f4b13b288a455cba839e4c5d651f16/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:28.170138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.170821 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.171437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.173023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:28.177071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3e1b6dc55a4b87b8caebb27fd721cb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.178393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8883db14-e591-4ac0-8efd-916c396079af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3e1b6dc55a4b87b8caebb27fd721cb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.193620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1139/2302] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:28 2022] DELETE /identity/v3/users/3a3e1b6dc55a4b87b8caebb27fd721cb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:28.195162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:28.196384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.197708 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.198001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.198286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.234030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] MFA Rules not processed for user `62f4b13b288a455cba839e4c5d651f16`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:28.235273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.273364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1164/2303] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:28.287546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:28.289014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.313659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1140/2304] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:28.326056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:28.327672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.365523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4feb5-592c-4ef8-999a-d4cd4cfa86ee None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:28.369771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:28.370395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.370612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.370898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.385244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:28.388031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:28.393132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d3a56-ffc1-46c9-8f56-08a419790100 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:28.397835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a50e4-bf36-4557-b365-1eff52db9cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:28.398485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a50e4-bf36-4557-b365-1eff52db9cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.398777 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a50e4-bf36-4557-b365-1eff52db9cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.399059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a50e4-bf36-4557-b365-1eff52db9cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.404339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1165/2305] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:28.408143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a50e4-bf36-4557-b365-1eff52db9cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:28.409683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a50e4-bf36-4557-b365-1eff52db9cf8 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:28.420471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1141/2306] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:28.450010 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:28.451958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.465231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85427849-37f3-4eaa-a35c-4e0ca976bd66 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:28.470195 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:28.471080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.471367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.471648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] PATH_INFO: `/v3/users/62f4b13b288a455cba839e4c5d651f16` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.472926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f4b13b288a455cba839e4c5d651f16)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:28.474911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:28.543855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f4b13b288a455cba839e4c5d651f16'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.556091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f4b13b288a455cba839e4c5d651f16'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.580130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f4b13b288a455cba839e4c5d651f16'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.580938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f4b13b288a455cba839e4c5d651f16'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.581646 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f4b13b288a455cba839e4c5d651f16'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.600169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1166/2307] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:28 2022] DELETE /identity/v3/users/62f4b13b288a455cba839e4c5d651f16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:28.604981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.605569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.606038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.627741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:28.630175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.634632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:28.636059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.664167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:28.745714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1142/2308] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:28.746173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b359f-2347-4fb2-ac7c-bcfdb34a7cce admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:28.754094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:28.755129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.755419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.756467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] PATH_INFO: `/v3/projects/26be8c366d8c4ad782ce11946e33fc0b` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.757938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26be8c366d8c4ad782ce11946e33fc0b)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:28.760016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:28.760151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:28.761494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.790115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:28.843501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26be8c366d8c4ad782ce11946e33fc0b', 'request_id': 'req-21767255-b6c2-4d96-9ba0-68d6793c69a9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.851678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0c539-0343-4b9e-8486-847f1f3116a7 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:28.852032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26be8c366d8c4ad782ce11946e33fc0b', 'request_id': 'req-21767255-b6c2-4d96-9ba0-68d6793c69a9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.862932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26be8c366d8c4ad782ce11946e33fc0b', 'request_id': 'req-21767255-b6c2-4d96-9ba0-68d6793c69a9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.898189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] The token cache is being invalidate because project 26be8c366d8c4ad782ce11946e33fc0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:28.898474 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.900179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:28.904627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1167/2309] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:28 2022] DELETE /identity/v3/projects/26be8c366d8c4ad782ce11946e33fc0b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:28.909464 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:28.911062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:28.942744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:28.943714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:28.944316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:28.944696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:28.947877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:29.031998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767255-b6c2-4d96-9ba0-68d6793c69a9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:29.038539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:29.039495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:29.039878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:29.040365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] PATH_INFO: `/v3/users/87f6997f14934c31b2186e9a329169f8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:29.042317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f6997f14934c31b2186e9a329169f8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:29.053235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:29.157225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:29.166243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:29.189747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f6997f14934c31b2186e9a329169f8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.189747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:29.200459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1143/2310] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:29.222147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f6997f14934c31b2186e9a329169f8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.255800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f6997f14934c31b2186e9a329169f8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.257173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f6997f14934c31b2186e9a329169f8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.258026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f6997f14934c31b2186e9a329169f8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.286667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1168/2311] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:28 2022] DELETE /identity/v3/users/87f6997f14934c31b2186e9a329169f8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:29.698642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:29.700197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:29.716879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8333e-d369-41d7-b0c4-3d87e52f4745 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:29.793149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:29.794036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:29.794317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:29.794597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] PATH_INFO: `/v3/projects/2ca8263773da4d3ca157704d94175d48` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:29.795907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca8263773da4d3ca157704d94175d48)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:29.797831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:29.832686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:29.850904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca8263773da4d3ca157704d94175d48', 'request_id': 'req-88f48a4a-dd61-4f96-a36f-bd9770450b33'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.860882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca8263773da4d3ca157704d94175d48', 'request_id': 'req-88f48a4a-dd61-4f96-a36f-bd9770450b33'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.868426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca8263773da4d3ca157704d94175d48', 'request_id': 'req-88f48a4a-dd61-4f96-a36f-bd9770450b33'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.883031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] The token cache is being invalidate because project 2ca8263773da4d3ca157704d94175d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:29.883323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.883989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-88f48a4a-dd61-4f96-a36f-bd9770450b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:29.886075 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1144/2312] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:29 2022] DELETE /identity/v3/projects/2ca8263773da4d3ca157704d94175d48 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:29.980690 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:29.982348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:30.017941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29dff-268a-444a-aada-82cd883709c0 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:30.119222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:30.121029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.121315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.121591 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] PATH_INFO: `/v3/projects/f6cac6389eaa4bd584445f81ba8f13ca` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.123801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cac6389eaa4bd584445f81ba8f13ca)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:30.126732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:30.194058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cac6389eaa4bd584445f81ba8f13ca', 'request_id': 'req-25e145ea-f2a5-47fd-8c41-cc53070fa954'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:30.201097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cac6389eaa4bd584445f81ba8f13ca', 'request_id': 'req-25e145ea-f2a5-47fd-8c41-cc53070fa954'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:30.214018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cac6389eaa4bd584445f81ba8f13ca', 'request_id': 'req-25e145ea-f2a5-47fd-8c41-cc53070fa954'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:30.229663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] The token cache is being invalidate because project f6cac6389eaa4bd584445f81ba8f13ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:30.230029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:30.230620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-25e145ea-f2a5-47fd-8c41-cc53070fa954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:30.235463 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1169/2313] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:29 2022] DELETE /identity/v3/projects/f6cac6389eaa4bd584445f81ba8f13ca => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:30.237235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf8bd-98f0-448d-8d82-e9208fc3e950 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.237694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf8bd-98f0-448d-8d82-e9208fc3e950 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.237798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf8bd-98f0-448d-8d82-e9208fc3e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.258801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-030cf8bd-98f0-448d-8d82-e9208fc3e950 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:30.260023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-030cf8bd-98f0-448d-8d82-e9208fc3e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:30.330502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1145/2314] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:30.338489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183b4c1-51f5-4ac2-9835-b607595a602e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.338802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183b4c1-51f5-4ac2-9835-b607595a602e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.339107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183b4c1-51f5-4ac2-9835-b607595a602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.358842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-3183b4c1-51f5-4ac2-9835-b607595a602e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:30.360065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3183b4c1-51f5-4ac2-9835-b607595a602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:30.368741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1170/2315] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:30.373397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf8bd-98f0-448d-8d82-e9208fc3e950 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:30.384328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf8bd-98f0-448d-8d82-e9208fc3e950 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:30.396182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:30.397376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.397670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.397955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.399288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:30.399913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:30.403581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:30.422704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1146/2316] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:57:30.424180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183b4c1-51f5-4ac2-9835-b607595a602e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:30.436288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183b4c1-51f5-4ac2-9835-b607595a602e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:30.441878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:30.442700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.443093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.443461 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.444236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:30.446308 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:30.480629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1171/2317] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:30 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:30.485653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:30.497839 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7984-cf9a-4d0d-8733-3331412a183b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:30.572680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:30.574150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.574876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.575260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.575969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:30.579245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:30.611341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:30.612099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1147/2318] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:30 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:30.628549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934981cc-5775-4a68-a212-4729bf2b520a admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:30.634673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:30.635345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.635634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.635894 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.636648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:30.638255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:30.655198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1172/2319] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:57:30.658363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:30.671031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a339acd-4281-4fc6-a6c8-8ac0ed3e41e0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:30.678961 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13822f55-2a7d-47cd-b44c-6ebe0f6c0bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:30.680361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13822f55-2a7d-47cd-b44c-6ebe0f6c0bbc admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.680673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13822f55-2a7d-47cd-b44c-6ebe0f6c0bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.680999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13822f55-2a7d-47cd-b44c-6ebe0f6c0bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.682397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13822f55-2a7d-47cd-b44c-6ebe0f6c0bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:30.684180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13822f55-2a7d-47cd-b44c-6ebe0f6c0bbc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:30.701247 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1148/2320] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:30.705502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:30.721890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cca5de-c108-4ae9-b541-1dc8ad48bd03 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:30.744664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:30.745558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.745843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.746183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] PATH_INFO: `/v3/projects/a9de5514ed904b8990b1a4f375b01bd9/users/6115ac6231d6421c913b5b6e9227f9a2/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.760999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:30.765164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9de5514ed904b8990b1a4f375b01bd9, user_id=6115ac6231d6421c913b5b6e9227f9a2, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:30.768101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:30.790354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1173/2321] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:30 2022] PUT /identity/v3/projects/a9de5514ed904b8990b1a4f375b01bd9/users/6115ac6231d6421c913b5b6e9227f9a2/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:57:30.795679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4e2b5-ee2a-4413-bacf-cb7a64728344 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:30.796055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4e2b5-ee2a-4413-bacf-cb7a64728344 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:30.796519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4e2b5-ee2a-4413-bacf-cb7a64728344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:30.832500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ccb4e2b5-ee2a-4413-bacf-cb7a64728344 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:30.837336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ccb4e2b5-ee2a-4413-bacf-cb7a64728344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:30.880139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:31.004064 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1149/2322] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:31.012063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:31.013926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:31.168372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8df716-3bd2-4d36-a678-6dce880fa26c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:31.173528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:31.174437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:31.174733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:31.175019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:31.188902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:31.219352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:31.243804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1174/2323] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:32.947255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a178-fdfb-448f-ab9f-b2d38a3b408b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:32.947741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a178-fdfb-448f-ab9f-b2d38a3b408b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:32.947845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a178-fdfb-448f-ab9f-b2d38a3b408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:32.991171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-dbd9a178-fdfb-448f-ab9f-b2d38a3b408b None None] MFA Rules not processed for user `6115ac6231d6421c913b5b6e9227f9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:32.993480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dbd9a178-fdfb-448f-ab9f-b2d38a3b408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:33.105515 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1150/2324] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:33.114073 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:33.115606 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:33.203922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc915a56-99e2-4335-ab77-c1f8451ff3f6 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:33.217259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:33.218138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:33.218580 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:33.219011 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:33.231291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:33.233199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:33.246862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1175/2325] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:34.750527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b80e-644b-4b12-8366-9ade0bf6b40d None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:34.751081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b80e-644b-4b12-8366-9ade0bf6b40d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:34.751081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b80e-644b-4b12-8366-9ade0bf6b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:34.784671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c580b80e-644b-4b12-8366-9ade0bf6b40d None None] MFA Rules not processed for user `6115ac6231d6421c913b5b6e9227f9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:34.788110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c580b80e-644b-4b12-8366-9ade0bf6b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:34.808257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1151/2326] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:35.441049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:35.445039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:35.471916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590447-1fd8-4ae9-a8c9-adea6a2baff2 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:35.477430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:35.478338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:35.478619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:35.478896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] PATH_INFO: `/v3/users/eb96f436fba94e40835cd8c4bb3df8c4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:35.480347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb96f436fba94e40835cd8c4bb3df8c4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:35.483786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:35.553550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb96f436fba94e40835cd8c4bb3df8c4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.561517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb96f436fba94e40835cd8c4bb3df8c4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.576354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb96f436fba94e40835cd8c4bb3df8c4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.577119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb96f436fba94e40835cd8c4bb3df8c4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.577737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb96f436fba94e40835cd8c4bb3df8c4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.596068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1176/2327] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:35 2022] DELETE /identity/v3/users/eb96f436fba94e40835cd8c4bb3df8c4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:35.792874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b80e-644b-4b12-8366-9ade0bf6b40d None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:35.809923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b80e-644b-4b12-8366-9ade0bf6b40d None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:35.873979 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:35.874890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:35.875176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:35.875460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] PATH_INFO: `/v3/projects/b2b84d47b94b4e9099e18fd26aa97739` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:35.876720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b84d47b94b4e9099e18fd26aa97739)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:35.878910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:35.934752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b84d47b94b4e9099e18fd26aa97739', 'request_id': 'req-58afce87-ece9-49d9-9048-178367989297'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.936970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:35.947204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b84d47b94b4e9099e18fd26aa97739', 'request_id': 'req-58afce87-ece9-49d9-9048-178367989297'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.954333 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b84d47b94b4e9099e18fd26aa97739', 'request_id': 'req-58afce87-ece9-49d9-9048-178367989297'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.965578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] The token cache is being invalidate because project b2b84d47b94b4e9099e18fd26aa97739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:35.965915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.966537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:35.968094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1152/2328] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:35 2022] DELETE /identity/v3/projects/b2b84d47b94b4e9099e18fd26aa97739 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:35.972363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:35.976943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:35.991086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b398-5ce0-4d5e-808d-88e8ac59a792 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:35.997106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:36.062184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:36.063197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.063547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.063896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] PATH_INFO: `/v3/users/9919c254447348a8b14cd4ac1ce033cc` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.065206 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9919c254447348a8b14cd4ac1ce033cc)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:36.067202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:36.135552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9919c254447348a8b14cd4ac1ce033cc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.146399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9919c254447348a8b14cd4ac1ce033cc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.168359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9919c254447348a8b14cd4ac1ce033cc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.169702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9919c254447348a8b14cd4ac1ce033cc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.170412 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-eccf75f0-7c1b-4ad3-8780-5a224ac6dfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9919c254447348a8b14cd4ac1ce033cc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.186835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1177/2329] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:57:35 2022] DELETE /identity/v3/users/9919c254447348a8b14cd4ac1ce033cc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:36.383969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:36.386324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:36.399530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afce87-ece9-49d9-9048-178367989297 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:36.466639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:36.467756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.468214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.468495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] PATH_INFO: `/v3/projects/23c3ad7d5f2547ab8551f78c3184671f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.469940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c3ad7d5f2547ab8551f78c3184671f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:36.471857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:36.527071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c3ad7d5f2547ab8551f78c3184671f', 'request_id': 'req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.539458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c3ad7d5f2547ab8551f78c3184671f', 'request_id': 'req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.545947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c3ad7d5f2547ab8551f78c3184671f', 'request_id': 'req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.559345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] The token cache is being invalidate because project 23c3ad7d5f2547ab8551f78c3184671f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:57:36.559718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.561663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1bb5fe43-1519-42cd-a7bb-edcbc3854a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:57:36.563342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1153/2330] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:57:36 2022] DELETE /identity/v3/projects/23c3ad7d5f2547ab8551f78c3184671f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:36.568371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f9143-919c-49e8-ba38-682d11fbedaf None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.568877 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f9143-919c-49e8-ba38-682d11fbedaf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.569286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f9143-919c-49e8-ba38-682d11fbedaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.589273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1d2f9143-919c-49e8-ba38-682d11fbedaf None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:36.590765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1d2f9143-919c-49e8-ba38-682d11fbedaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:36.669135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1178/2331] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:36.677174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1004-1766-4793-9b5a-bcedf532ef58 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.678049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1004-1766-4793-9b5a-bcedf532ef58 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.678383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1004-1766-4793-9b5a-bcedf532ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.698772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5f9d1004-1766-4793-9b5a-bcedf532ef58 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:36.699861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5f9d1004-1766-4793-9b5a-bcedf532ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:36.712842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1154/2332] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:36.713469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f9143-919c-49e8-ba38-682d11fbedaf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:36.723743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f9143-919c-49e8-ba38-682d11fbedaf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:36.730903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:36.731749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.731983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.732339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.733370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:57:36.737126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:36.737126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:36.752652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1179/2333] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:57:36.755598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d1004-1766-4793-9b5a-bcedf532ef58 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:36.764897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d1004-1766-4793-9b5a-bcedf532ef58 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:36.769801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:36.770534 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.770818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.771675 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.772363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:36.774322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:36.800817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1155/2334] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:36 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:36.805708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:36.816037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cbec6-249b-4678-8efa-059c3332c2e3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:36.827755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:36.877628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:36.878307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.878597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.878876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.879579 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:36.881567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:36.907666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1180/2335] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:36 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:36.909360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:36.920748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa7aeb-397e-4389-8325-e33a0ae7a4c2 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:36.926279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:36.927032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.927321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.927668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.928406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:36.930220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:36.945014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1156/2336] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:36.946460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:36.960324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdfd23-24a1-4686-8784-a9511e66fb77 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:36.968115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e6156-cf01-4803-89cb-c2d55c687a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:36.968891 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6156-cf01-4803-89cb-c2d55c687a30 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:36.969268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6156-cf01-4803-89cb-c2d55c687a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:36.969627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6156-cf01-4803-89cb-c2d55c687a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:36.970434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e6156-cf01-4803-89cb-c2d55c687a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:36.972265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e6156-cf01-4803-89cb-c2d55c687a30 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:36.985938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1181/2337] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:36.990335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:37.003220 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0641b-f5cc-471a-9af5-e8fbcd68dd92 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:37.008135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:37.009095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:37.021641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:37.022284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] PATH_INFO: `/v3/projects/8ef110d054e4440d91b0cd057279d813/users/42e09b598a2d409e83f7e3c903cd3bad/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:37.047020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef110d054e4440d91b0cd057279d813, user_id=42e09b598a2d409e83f7e3c903cd3bad, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:37.050416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:37.069983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1157/2338] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:36 2022] PUT /identity/v3/projects/8ef110d054e4440d91b0cd057279d813/users/42e09b598a2d409e83f7e3c903cd3bad/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:37.080718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f46de-71fc-4063-98f6-f0b850307140 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:37.081044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f46de-71fc-4063-98f6-f0b850307140 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:37.081301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f46de-71fc-4063-98f6-f0b850307140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:37.114504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7e6f46de-71fc-4063-98f6-f0b850307140 None None] MFA Rules not processed for user `42e09b598a2d409e83f7e3c903cd3bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:37.115878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7e6f46de-71fc-4063-98f6-f0b850307140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:37.219876 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1182/2339] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:37.233400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:37.235141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:37.242430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:37.315156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8abaf5-3a89-483c-b1ff-75d361280090 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:37.321486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:37.321670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:37.321824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:37.322697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:37.332970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:37.334990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:37.344935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1158/2340] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:57:37.617261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9405d-c72f-4e75-8446-4a1cb2b960dc None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:37.617758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9405d-c72f-4e75-8446-4a1cb2b960dc None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:37.617966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9405d-c72f-4e75-8446-4a1cb2b960dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:37.667226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-9ef9405d-c72f-4e75-8446-4a1cb2b960dc None None] MFA Rules not processed for user `c9a0569d0a7641a9858c0810219b1ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:37.668707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9ef9405d-c72f-4e75-8446-4a1cb2b960dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:37.790476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1183/2341] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:37.793038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:37.794599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:37.897820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539a0a-f7f8-42c5-a85f-a528ed95358b service glance] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:37.906801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:37.907590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:37.907889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:37.908209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:37.910639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:37.913687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:37.963217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1159/2342] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:57:37 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:57:37.963951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9405d-c72f-4e75-8446-4a1cb2b960dc None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:37.982727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9405d-c72f-4e75-8446-4a1cb2b960dc None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:38.006046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:38.097990 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:38.098873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:38.099431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:38.100012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:38.101007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:38.103000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:38.136627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1184/2343] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:57:37 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:57:38.138344 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:38.150167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38b02-c36e-42a2-a3e7-8353b65464d3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:38.155269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:38.155963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:38.156255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:38.156554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:38.157596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:38.159367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:38.174261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1160/2344] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:38.179417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:38.199715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db749e21-c697-489f-8e16-09c2fdb03476 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:38.226204 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:38.227128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:38.227424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:38.227686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] PATH_INFO: `/v3/projects/bfdbd39af6994a8586e0a589a3c9640e/users/57c14b0bd17049b684ecd0669b68d0e5/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:38.269008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdbd39af6994a8586e0a589a3c9640e, user_id=57c14b0bd17049b684ecd0669b68d0e5, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:38.271714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:38.299415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1185/2345] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:38 2022] PUT /identity/v3/projects/bfdbd39af6994a8586e0a589a3c9640e/users/57c14b0bd17049b684ecd0669b68d0e5/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:38.304430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:38.326913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a0207-c8ce-4db8-9583-a14afc3c860c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:38.449490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cba9-2c39-4a99-85e2-a45382f16f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:38.450224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cba9-2c39-4a99-85e2-a45382f16f8e admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:38.450510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cba9-2c39-4a99-85e2-a45382f16f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:38.450786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cba9-2c39-4a99-85e2-a45382f16f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:38.451517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085cba9-2c39-4a99-85e2-a45382f16f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:38.460700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085cba9-2c39-4a99-85e2-a45382f16f8e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:38.488237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1161/2346] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:57:38.492530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:38.527280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebb32b-e4d5-472c-a004-5c1981191e79 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:38.543947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:38.545231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:38.546552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:38.549044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] PATH_INFO: `/v3/projects/bfdbd39af6994a8586e0a589a3c9640e/users/57c14b0bd17049b684ecd0669b68d0e5/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:38.555165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdbd39af6994a8586e0a589a3c9640e, user_id=57c14b0bd17049b684ecd0669b68d0e5, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:38.563230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:38.602619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1186/2347] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:57:38 2022] PUT /identity/v3/projects/bfdbd39af6994a8586e0a589a3c9640e/users/57c14b0bd17049b684ecd0669b68d0e5/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:57:45.009724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e501-f1a9-4c46-a86c-72595984675d None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:45.010206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e501-f1a9-4c46-a86c-72595984675d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:45.010206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e501-f1a9-4c46-a86c-72595984675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:45.055318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-9142e501-f1a9-4c46-a86c-72595984675d None None] MFA Rules not processed for user `57c14b0bd17049b684ecd0669b68d0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:45.058131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9142e501-f1a9-4c46-a86c-72595984675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:45.091668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:45.200460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1162/2348] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:45.327974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:57:45.333061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:45.411054 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb01f3-5551-445d-bf72-350f113927ef admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:57:45.417185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1940b03-91f1-4960-b9db-d1a1dc2631c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:57:45.417866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1940b03-91f1-4960-b9db-d1a1dc2631c5 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:45.418136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1940b03-91f1-4960-b9db-d1a1dc2631c5 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:45.418497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1940b03-91f1-4960-b9db-d1a1dc2631c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:45.484261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1940b03-91f1-4960-b9db-d1a1dc2631c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:57:45.486118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1940b03-91f1-4960-b9db-d1a1dc2631c5 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:57:45.498318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1187/2349] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:57:46.613318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5fe5-1344-4284-ab8e-75e693a14fc1 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:46.613900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5fe5-1344-4284-ab8e-75e693a14fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:46.613900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5fe5-1344-4284-ab8e-75e693a14fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:46.637077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c80b5fe5-1344-4284-ab8e-75e693a14fc1 None None] MFA Rules not processed for user `c9a0569d0a7641a9858c0810219b1ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:46.638324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c80b5fe5-1344-4284-ab8e-75e693a14fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:46.645453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1163/2350] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:52.658242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9917a7-589e-4062-93ee-8357c10a9183 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:52.658785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9917a7-589e-4062-93ee-8357c10a9183 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:52.658785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9917a7-589e-4062-93ee-8357c10a9183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:52.665659 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:52.681931 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-2a9917a7-589e-4062-93ee-8357c10a9183 None None] MFA Rules not processed for user `2aa34e012c824754833a12ac66413aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:52.683157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2a9917a7-589e-4062-93ee-8357c10a9183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:52.744977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1188/2351] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:57:56.630768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=30 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:57:57.683508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:57:57.684446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:57:57.684964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:57:57.705150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] MFA Rules not processed for user `6115ac6231d6421c913b5b6e9227f9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:57:57.706659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:57:57.764205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1164/2352] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:02.737720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=24 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:03.528001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5981a-347d-4e5a-924f-647d357dc9e5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:03.528368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5981a-347d-4e5a-924f-647d357dc9e5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:03.528681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5981a-347d-4e5a-924f-647d357dc9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:03.559350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-40a5981a-347d-4e5a-924f-647d357dc9e5 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:03.560721 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-40a5981a-347d-4e5a-924f-647d357dc9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:03.624107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1189/2353] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:03.640032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:03.641429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:03.722123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b78c2-7976-42d8-b150-9951ccd58d49 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:03.727313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080fb9-362d-4cb7-a394-cf4808c1a080 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:03.727972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080fb9-362d-4cb7-a394-cf4808c1a080 service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:03.728262 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080fb9-362d-4cb7-a394-cf4808c1a080 service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:03.728548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080fb9-362d-4cb7-a394-cf4808c1a080 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:03.738797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a080fb9-362d-4cb7-a394-cf4808c1a080 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:03.741122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a080fb9-362d-4cb7-a394-cf4808c1a080 service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:03.749498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1165/2354] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:58:13.616885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=32 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:13.746161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=57 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:17.237108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5981a-347d-4e5a-924f-647d357dc9e5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:17.312564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5981a-347d-4e5a-924f-647d357dc9e5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:17.317777 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:17.318661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:17.318952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:17.319233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] PATH_INFO: `/v3/users/42e09b598a2d409e83f7e3c903cd3bad` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:17.320482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e09b598a2d409e83f7e3c903cd3bad)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:17.322546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:17.371696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e09b598a2d409e83f7e3c903cd3bad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:17.378774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e09b598a2d409e83f7e3c903cd3bad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:17.391829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e09b598a2d409e83f7e3c903cd3bad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:17.392547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e09b598a2d409e83f7e3c903cd3bad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:17.393196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e09b598a2d409e83f7e3c903cd3bad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:17.406587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1190/2355] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:58:17 2022] DELETE /identity/v3/users/42e09b598a2d409e83f7e3c903cd3bad => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:17.411861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:17.412338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:17.412338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:17.430236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:17.431678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:17.494547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1166/2356] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:17.504348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:17.506747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:17.571966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741b8a9-2ff1-464e-872d-f83b15266c9e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:17.575753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4363ad3-4802-402d-aa24-2ebed49ae70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:17.576407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4363ad3-4802-402d-aa24-2ebed49ae70e service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:17.576728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4363ad3-4802-402d-aa24-2ebed49ae70e service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:17.577013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4363ad3-4802-402d-aa24-2ebed49ae70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:17.589725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4363ad3-4802-402d-aa24-2ebed49ae70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:17.591176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4363ad3-4802-402d-aa24-2ebed49ae70e service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:17.601084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1191/2357] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:17.908200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:17.909866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:17.922355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5be4-6aa4-4f7c-8fc6-6d78a26c32df None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:17.927576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:17.929285 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:17.929574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:17.929848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] PATH_INFO: `/v3/projects/8ef110d054e4440d91b0cd057279d813` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:17.931387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef110d054e4440d91b0cd057279d813)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:17.933159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:17.985006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef110d054e4440d91b0cd057279d813', 'request_id': 'req-b164130e-1a36-4a20-b90c-33807ab03d6a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:17.992258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef110d054e4440d91b0cd057279d813', 'request_id': 'req-b164130e-1a36-4a20-b90c-33807ab03d6a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:17.998167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef110d054e4440d91b0cd057279d813', 'request_id': 'req-b164130e-1a36-4a20-b90c-33807ab03d6a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:18.009069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] The token cache is being invalidate because project 8ef110d054e4440d91b0cd057279d813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:58:18.009356 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:18.010002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-b164130e-1a36-4a20-b90c-33807ab03d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:18.011518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1167/2358] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:58:17 2022] DELETE /identity/v3/projects/8ef110d054e4440d91b0cd057279d813 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:18.016282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b444c0-453c-45bf-bc19-fc3b18916989 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.016605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b444c0-453c-45bf-bc19-fc3b18916989 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.016889 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b444c0-453c-45bf-bc19-fc3b18916989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.045988 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c7b444c0-453c-45bf-bc19-fc3b18916989 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:18.047173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c7b444c0-453c-45bf-bc19-fc3b18916989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:18.055710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:18.106282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1192/2359] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:18.113865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a596d1-09b4-41d1-8b2d-3bee50942bfa None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.114181 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a596d1-09b4-41d1-8b2d-3bee50942bfa None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.114469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a596d1-09b4-41d1-8b2d-3bee50942bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.132838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-74a596d1-09b4-41d1-8b2d-3bee50942bfa None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:18.134040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-74a596d1-09b4-41d1-8b2d-3bee50942bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:18.142087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1168/2360] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:18.146559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b444c0-453c-45bf-bc19-fc3b18916989 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:18.155936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b444c0-453c-45bf-bc19-fc3b18916989 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:18.160392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:18.161712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.161995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.162271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.162992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:58:18.163296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:18.164932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:18.176135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1193/2361] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:58:18.180851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a596d1-09b4-41d1-8b2d-3bee50942bfa None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:18.189825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a596d1-09b4-41d1-8b2d-3bee50942bfa None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:18.195184 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:18.195844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.196126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.196403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.197156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:18.199070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:18.226281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1169/2362] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:58:18 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:58:18.230356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:18.240660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e22d-167f-4b58-9e83-fadb66c94ed2 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:18.302043 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:18.302788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.303139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.303478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.304226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:18.306230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:18.331994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1194/2363] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:58:18 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:58:18.333287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:18.344193 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1a8c7-276b-43e2-9c92-2e727d79d82d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:18.349636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:18.350385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.350739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.351086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.351909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:18.353619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:18.365272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1170/2364] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:58:18.369297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:18.380193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83687c-181a-421a-9807-cecd22603fe8 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:18.385050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868aea83-3220-4905-a2b0-ff015b05cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:18.385713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aea83-3220-4905-a2b0-ff015b05cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.385997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aea83-3220-4905-a2b0-ff015b05cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.386272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aea83-3220-4905-a2b0-ff015b05cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.387026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868aea83-3220-4905-a2b0-ff015b05cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:18.388630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868aea83-3220-4905-a2b0-ff015b05cb51 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:18.402168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1195/2365] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:58:18.412011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:18.425310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031cf3e-67e3-4031-98e6-49929d1570db admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:18.434325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:18.435228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.435528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.435793 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] PATH_INFO: `/v3/projects/d48476a356f24696bd88841753d25ace/users/ca9a9880461841ec81ab65939a39536e/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.452760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48476a356f24696bd88841753d25ace, user_id=ca9a9880461841ec81ab65939a39536e, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:18.455469 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:18.474541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1171/2366] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:58:18 2022] PUT /identity/v3/projects/d48476a356f24696bd88841753d25ace/users/ca9a9880461841ec81ab65939a39536e/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:18.485165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901847c-d295-4717-88a4-14b80c73543f None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.485457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901847c-d295-4717-88a4-14b80c73543f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.485727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901847c-d295-4717-88a4-14b80c73543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.513914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e901847c-d295-4717-88a4-14b80c73543f None None] MFA Rules not processed for user `ca9a9880461841ec81ab65939a39536e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:18.515135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e901847c-d295-4717-88a4-14b80c73543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:18.585955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1196/2367] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:18.597394 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:18.599770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:18.623569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:18.682952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c898690-e78d-4c13-935b-481f07e9435b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:18.686887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa82ae8-b277-4212-a60d-37f43afb2a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:18.687557 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa82ae8-b277-4212-a60d-37f43afb2a9a service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:18.688474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa82ae8-b277-4212-a60d-37f43afb2a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:18.688474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa82ae8-b277-4212-a60d-37f43afb2a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:18.697598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa82ae8-b277-4212-a60d-37f43afb2a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:18.699188 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa82ae8-b277-4212-a60d-37f43afb2a9a service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:18.709810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1172/2368] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:21.291524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901847c-d295-4717-88a4-14b80c73543f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:21.303150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:21.362650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901847c-d295-4717-88a4-14b80c73543f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:21.367460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:21.368351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:21.368671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:21.368961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] PATH_INFO: `/v3/users/ca9a9880461841ec81ab65939a39536e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:21.370178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9a9880461841ec81ab65939a39536e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:21.372162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:21.422198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9a9880461841ec81ab65939a39536e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:21.430678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9a9880461841ec81ab65939a39536e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:21.444734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9a9880461841ec81ab65939a39536e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:21.445472 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9a9880461841ec81ab65939a39536e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:21.446092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9a9880461841ec81ab65939a39536e'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:21.461209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1197/2369] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:58:21 2022] DELETE /identity/v3/users/ca9a9880461841ec81ab65939a39536e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:58:21.465832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:21.466325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:21.466423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:21.484095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:21.485427 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:21.545480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1173/2370] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:21.555449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:21.556980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:21.614427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23730f0e-daa7-48e9-8c98-4e307e1826fa admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:21.618239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497608-130f-43a0-bf04-40119570b88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:21.618886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497608-130f-43a0-bf04-40119570b88e service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:21.619172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497608-130f-43a0-bf04-40119570b88e service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:21.619452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497608-130f-43a0-bf04-40119570b88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:21.628444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57497608-130f-43a0-bf04-40119570b88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:21.630459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57497608-130f-43a0-bf04-40119570b88e service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:21.639731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1198/2371] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:22.284531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.287364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:22.300782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4440-54c6-47ce-b8d3-ab1dc871ac00 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:22.307315 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:22.308607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.309069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.309507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] PATH_INFO: `/v3/projects/d48476a356f24696bd88841753d25ace` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.310941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48476a356f24696bd88841753d25ace)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:22.313319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:22.368898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48476a356f24696bd88841753d25ace', 'request_id': 'req-c309b73b-173e-439a-b60e-f827e20125cc'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:22.377513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48476a356f24696bd88841753d25ace', 'request_id': 'req-c309b73b-173e-439a-b60e-f827e20125cc'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:22.384328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48476a356f24696bd88841753d25ace', 'request_id': 'req-c309b73b-173e-439a-b60e-f827e20125cc'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:22.397447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] The token cache is being invalidate because project d48476a356f24696bd88841753d25ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:58:22.397748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:22.398748 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c309b73b-173e-439a-b60e-f827e20125cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:22.404367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1174/2372] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:58:22 2022] DELETE /identity/v3/projects/d48476a356f24696bd88841753d25ace => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:22.406620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd73d6-c7d4-4b3d-bb85-78963f1bec1c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.407123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd73d6-c7d4-4b3d-bb85-78963f1bec1c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.407335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd73d6-c7d4-4b3d-bb85-78963f1bec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.427100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-30cd73d6-c7d4-4b3d-bb85-78963f1bec1c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:22.428483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-30cd73d6-c7d4-4b3d-bb85-78963f1bec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:22.459328 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:22.508724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1199/2373] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:22.515088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca432d-830f-4d92-a409-78214f0709d5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.515596 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca432d-830f-4d92-a409-78214f0709d5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.515681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca432d-830f-4d92-a409-78214f0709d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.534775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e2ca432d-830f-4d92-a409-78214f0709d5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:22.536564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e2ca432d-830f-4d92-a409-78214f0709d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:22.544818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1175/2374] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:22.549083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd73d6-c7d4-4b3d-bb85-78963f1bec1c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.566120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd73d6-c7d4-4b3d-bb85-78963f1bec1c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:22.572543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:22.573332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.573715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.574135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.575019 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:58:22.575406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:22.577280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:22.590878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1200/2375] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:58:22.594994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca432d-830f-4d92-a409-78214f0709d5 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.606144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca432d-830f-4d92-a409-78214f0709d5 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:22.611252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0555f9-94cf-4814-b2b3-275ec270cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:22.611919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0555f9-94cf-4814-b2b3-275ec270cdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.612370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0555f9-94cf-4814-b2b3-275ec270cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.612927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0555f9-94cf-4814-b2b3-275ec270cdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.613805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0555f9-94cf-4814-b2b3-275ec270cdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:22.616338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0555f9-94cf-4814-b2b3-275ec270cdb3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:22.647320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:22.658429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1176/2376] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:58:22 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:58:22.662830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.677939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e558bb-845e-4b42-8764-6b33c7b4192f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:22.763110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44baa5-e93f-45a1-9ba6-0d66558aaa7d None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.763405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44baa5-e93f-45a1-9ba6-0d66558aaa7d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.763696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44baa5-e93f-45a1-9ba6-0d66558aaa7d None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.764382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:22.765114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1177/2377] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:58:22.765274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.765683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.766057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.766885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:22.769294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:22.771888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.772375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.772888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.800752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1201/2378] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:58:22 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:58:22.804138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.814437 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9c94d-1695-4ecb-9a37-f9e92024b105 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:22.819921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:22.820604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.820907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.821192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.821920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:22.823556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:22.837951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1202/2379] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:58:22.842023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.847215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:22.848721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:22.858071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11be98-6c39-4d80-8b35-76c291f6366f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:22.867703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:22.867703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.870584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.870584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.870584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:22.871224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:22.904173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1203/2380] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:58:22.904173 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.914792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9036-cce0-4943-a5d3-a7c27c1f0470 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:22.921541 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b836-def1-4602-8269-bd914638b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:22.922964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b836-def1-4602-8269-bd914638b836 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.923154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b836-def1-4602-8269-bd914638b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.923492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b836-def1-4602-8269-bd914638b836 admin admin] PATH_INFO: `/v3/projects/51aa9f371a9c4b20bd52f8e251c80711/users/0eed26f817524cc292be459f2aaa6f6e/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.943528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b836-def1-4602-8269-bd914638b836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51aa9f371a9c4b20bd52f8e251c80711, user_id=0eed26f817524cc292be459f2aaa6f6e, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:22.946722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b836-def1-4602-8269-bd914638b836 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:22.961774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1204/2381] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:58:22 2022] PUT /identity/v3/projects/51aa9f371a9c4b20bd52f8e251c80711/users/0eed26f817524cc292be459f2aaa6f6e/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:22.966572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:22.966791 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:22.967074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:22.972159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1178/2382] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:58:22.985138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:22.986345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:22.990396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:22.992322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:23.067289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1205/2383] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:58:23.075275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:23.078276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:23.080486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c7bb7-0704-4767-9a43-c5c6257352d0 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:23.084966 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:23.143627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3e20-f71d-4f23-9ce0-1378c0ff3128 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:23.144425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3e20-f71d-4f23-9ce0-1378c0ff3128 service glance] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.144850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3e20-f71d-4f23-9ce0-1378c0ff3128 service glance] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.145175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3e20-f71d-4f23-9ce0-1378c0ff3128 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.150505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:23.155250 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf5d2-51c2-49ab-87ab-8ea5e1f33a82 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:23.159661 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf25ed0-a175-43f4-a2cc-843982623e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:23.160424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25ed0-a175-43f4-a2cc-843982623e58 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.161460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25ed0-a175-43f4-a2cc-843982623e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.161825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf25ed0-a175-43f4-a2cc-843982623e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.173075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf25ed0-a175-43f4-a2cc-843982623e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:23.175031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf25ed0-a175-43f4-a2cc-843982623e58 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:23.186268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1206/2384] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:58:23.241533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3e20-f71d-4f23-9ce0-1378c0ff3128 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:23.243065 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3e20-f71d-4f23-9ce0-1378c0ff3128 service glance] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:23.256191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1179/2385] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:23.332084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63da94-2770-41b0-b7ec-9fb7cc334020 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.333051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63da94-2770-41b0-b7ec-9fb7cc334020 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.333963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63da94-2770-41b0-b7ec-9fb7cc334020 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.336619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1207/2386] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:58:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:58:23.342375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f43bf-a7f5-4828-bec8-121e88765e98 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.342891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f43bf-a7f5-4828-bec8-121e88765e98 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.343318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f43bf-a7f5-4828-bec8-121e88765e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.368105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-0a4f43bf-a7f5-4828-bec8-121e88765e98 None None] MFA Rules not processed for user `1aa975bb70624500aa802e7a708014c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:23.369671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0a4f43bf-a7f5-4828-bec8-121e88765e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:23.379479 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1180/2387] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:23.397156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63da94-2770-41b0-b7ec-9fb7cc334020 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:23.399527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ab63da94-2770-41b0-b7ec-9fb7cc334020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:23.415213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63da94-2770-41b0-b7ec-9fb7cc334020 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:23.418912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b25c72-1fdc-475a-9d55-7da2abc0c395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:23.419557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25c72-1fdc-475a-9d55-7da2abc0c395 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.420023 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25c72-1fdc-475a-9d55-7da2abc0c395 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.420309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25c72-1fdc-475a-9d55-7da2abc0c395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.428664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b25c72-1fdc-475a-9d55-7da2abc0c395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:23.430099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b25c72-1fdc-475a-9d55-7da2abc0c395 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:23.439458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1208/2388] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:23.537805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a8e7e-cdb2-48d0-9f16-5a2cfbb5891e None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.539413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a8e7e-cdb2-48d0-9f16-5a2cfbb5891e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.539884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a8e7e-cdb2-48d0-9f16-5a2cfbb5891e None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.541766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1181/2389] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 14:58:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:58:23.548843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37705fe8-2211-4467-a515-fa5c4c5296ec None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.549172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37705fe8-2211-4467-a515-fa5c4c5296ec None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.549638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37705fe8-2211-4467-a515-fa5c4c5296ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.572773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-37705fe8-2211-4467-a515-fa5c4c5296ec None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:23.574311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-37705fe8-2211-4467-a515-fa5c4c5296ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:23.586633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1209/2390] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:23.600451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a8e7e-cdb2-48d0-9f16-5a2cfbb5891e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:23.625369 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a8e7e-cdb2-48d0-9f16-5a2cfbb5891e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:23.633521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:23.634312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:23.634695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:23.635336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:23.672403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:23.676410 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:23.702745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1182/2391] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:27.636539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323d46-e02c-4adf-8789-23cbb9770c95 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:27.637075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323d46-e02c-4adf-8789-23cbb9770c95 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:27.637194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323d46-e02c-4adf-8789-23cbb9770c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:27.666869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-97323d46-e02c-4adf-8789-23cbb9770c95 None None] MFA Rules not processed for user `0eed26f817524cc292be459f2aaa6f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:27.667795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-97323d46-e02c-4adf-8789-23cbb9770c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:27.745133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1210/2392] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:58:27.749976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:27.763286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97605d-a946-47c9-8876-d684bd81afaf service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:27.768352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa10b6a-f69b-46ba-9979-26cdbb84d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:27.769252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10b6a-f69b-46ba-9979-26cdbb84d123 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:27.769824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10b6a-f69b-46ba-9979-26cdbb84d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:27.769824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10b6a-f69b-46ba-9979-26cdbb84d123 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:27.770620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa10b6a-f69b-46ba-9979-26cdbb84d123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:27.773152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa10b6a-f69b-46ba-9979-26cdbb84d123 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:27.822110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1183/2393] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:58:27 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:58:27.827422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323d46-e02c-4adf-8789-23cbb9770c95 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:27.876634 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323d46-e02c-4adf-8789-23cbb9770c95 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:27.915392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:27.915695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:27.916111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:27.989992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:27.991306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:27.992093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:27.993284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:27.995203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:27.995910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:27.997352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:27.998026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:28.029818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1211/2394] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:58:27 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:58:28.034671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:28.045920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:28.060243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4847f2-eeaa-4e35-b702-c267c357c640 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:28.074934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:28.078818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:28.078818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:28.079339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:28.082013 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:28.088693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:28.116639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1212/2395] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:58:28.121465 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:28.154240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b9a1-1164-46df-bffc-10896d34c876 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:28.165486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:28.193056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:28.193492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:28.194000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] PATH_INFO: `/v3/projects/a5cf3ef49d7342e7938fcecf26730db7/users/b451417795c540e1b28874f159b34e3e/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:28.198621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1184/2396] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:58:28.209300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:28.212391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:28.221313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cf3ef49d7342e7938fcecf26730db7, user_id=b451417795c540e1b28874f159b34e3e, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:28.226236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:28.258734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1213/2397] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:58:28 2022] PUT /identity/v3/projects/a5cf3ef49d7342e7938fcecf26730db7/users/b451417795c540e1b28874f159b34e3e/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:28.263771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:28.272459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:28.361701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294c797-f0a6-484d-9582-0a13b7f54f44 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:28.367393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:28.368239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:28.368376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:28.368792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:28.369692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:28.371419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:28.372714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8e702-892f-4e64-ae46-bbf6068411d3 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:28.383732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1214/2398] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:58:28.388223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:28.401588 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dea73-0282-495d-9035-cab2cb791892 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:28.409552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37fc36-8058-4c0d-906f-2abc8c0ad826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:28.418394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37fc36-8058-4c0d-906f-2abc8c0ad826 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:28.418394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37fc36-8058-4c0d-906f-2abc8c0ad826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:28.418394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37fc36-8058-4c0d-906f-2abc8c0ad826 admin admin] PATH_INFO: `/v3/projects/a5cf3ef49d7342e7938fcecf26730db7/users/b451417795c540e1b28874f159b34e3e/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:28.419358 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37fc36-8058-4c0d-906f-2abc8c0ad826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cf3ef49d7342e7938fcecf26730db7, user_id=b451417795c540e1b28874f159b34e3e, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:28.423495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37fc36-8058-4c0d-906f-2abc8c0ad826 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:28.441130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1215/2399] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:58:28 2022] PUT /identity/v3/projects/a5cf3ef49d7342e7938fcecf26730db7/users/b451417795c540e1b28874f159b34e3e/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:28.474380 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:28.475215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:28.475516 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:28.475882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:28.543114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:28.545692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:28.555417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1185/2400] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:58:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:58:31.386132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd6d6-2012-43f9-9f9a-a23ef37ac051 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:31.387030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd6d6-2012-43f9-9f9a-a23ef37ac051 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:31.387572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd6d6-2012-43f9-9f9a-a23ef37ac051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:31.428505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-4bcdd6d6-2012-43f9-9f9a-a23ef37ac051 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:31.430462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4bcdd6d6-2012-43f9-9f9a-a23ef37ac051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:31.576398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1216/2401] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:31.591670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:31.606272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550973d8-9586-48f2-9085-ca03c74099fa service swift] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:31.701259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:31.733274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:31.734367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:31.734876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:31.735376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:31.758548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:31.760327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:31.769857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1186/2402] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:58:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:58:37.784703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:37.785337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:37.785337 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:37.846667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] MFA Rules not processed for user `b451417795c540e1b28874f159b34e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:37.851744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:37.993144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:38.058167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1217/2403] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:41.766478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=10 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:42.741867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:42.961720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba6685-3463-46b9-b65c-b15adb38d26b service swift] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:42.975812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:42.976493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:42.980428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:42.980877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:42.983351 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:43.159071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:43.161892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:43.181025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1187/2404] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:58:45.549032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:45.551377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:45.786677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f38dea-3b07-45c6-931c-c17d81f6f7fd None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:45.794388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ea77-b979-4661-88a4-708b90607c48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:45.796728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ea77-b979-4661-88a4-708b90607c48 service placement] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:45.798170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ea77-b979-4661-88a4-708b90607c48 service placement] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:45.798840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ea77-b979-4661-88a4-708b90607c48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:45.809824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-6bb5ea77-b979-4661-88a4-708b90607c48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:45.841959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ea77-b979-4661-88a4-708b90607c48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:45.846710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ea77-b979-4661-88a4-708b90607c48 service placement] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:45.865403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1218/2405] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:47.976711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:48.075682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c767c-744d-4a56-9f5c-4ebd48f4d8f8 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:48.079770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:48.080717 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:48.081245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:48.081750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:48.157040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:48.158891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:48.174094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1188/2406] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:48.327091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee20e-90aa-4f44-aea8-486ae9db12a8 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:48.327632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee20e-90aa-4f44-aea8-486ae9db12a8 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:48.327632 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee20e-90aa-4f44-aea8-486ae9db12a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:48.372566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-15aee20e-90aa-4f44-aea8-486ae9db12a8 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:48.376070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-15aee20e-90aa-4f44-aea8-486ae9db12a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:48.384297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1219/2407] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:48.397154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:48.405654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:48.411468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e0468-199d-4d87-9b58-092cf650187b service glance] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:48.421780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:48.422828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:48.423216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:48.427283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:48.445386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:48.447668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:48.459355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1189/2408] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:58:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:58:53.598260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:53.598825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:53.598825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:53.620937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:53.622263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:53.630491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1220/2409] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 18 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:53.647772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:53.663194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af991c3c-3d45-4451-ba86-82e6bf6111ea service swift] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:53.668491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:53.669239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:53.669703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:53.670063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:53.682156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:53.683869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:53.693239 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1190/2410] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:58:56.018360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:56.021385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:56.107118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8f708-8699-4b6b-9444-bbfd28665763 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:56.112140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:56.113063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:56.113848 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:56.114126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] PATH_INFO: `/v3/users/6115ac6231d6421c913b5b6e9227f9a2` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:56.115495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6115ac6231d6421c913b5b6e9227f9a2)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:56.117515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:56.166093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:56.172290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6115ac6231d6421c913b5b6e9227f9a2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.185421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6115ac6231d6421c913b5b6e9227f9a2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.202462 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6115ac6231d6421c913b5b6e9227f9a2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.203357 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6115ac6231d6421c913b5b6e9227f9a2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.203978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a5032fcd-d594-4c01-b0df-85d8458d38a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6115ac6231d6421c913b5b6e9227f9a2'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.232313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1221/2411] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:58:56 2022] DELETE /identity/v3/users/6115ac6231d6421c913b5b6e9227f9a2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:56.436865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:56.446820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0d2c-5bcf-4187-8f39-8f75e26a70b8 service swift] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:56.522345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:56.523237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:56.523532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:56.523922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] PATH_INFO: `/v3/projects/a9de5514ed904b8990b1a4f375b01bd9` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:56.525186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9de5514ed904b8990b1a4f375b01bd9)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:56.527189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:56.590627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9de5514ed904b8990b1a4f375b01bd9', 'request_id': 'req-be099212-90a8-4a0c-badd-d1c554d64fa8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.602338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9de5514ed904b8990b1a4f375b01bd9', 'request_id': 'req-be099212-90a8-4a0c-badd-d1c554d64fa8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.608724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9de5514ed904b8990b1a4f375b01bd9', 'request_id': 'req-be099212-90a8-4a0c-badd-d1c554d64fa8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.621291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] The token cache is being invalidate because project a9de5514ed904b8990b1a4f375b01bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:58:56.621825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.622563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-be099212-90a8-4a0c-badd-d1c554d64fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:58:56.624117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1191/2412] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:58:56 2022] DELETE /identity/v3/projects/a9de5514ed904b8990b1a4f375b01bd9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:58:56.629318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24bd73-c065-4cb1-bc66-40cc6efa1173 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:56.630174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24bd73-c065-4cb1-bc66-40cc6efa1173 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:56.630556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24bd73-c065-4cb1-bc66-40cc6efa1173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:56.654000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-0b24bd73-c065-4cb1-bc66-40cc6efa1173 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:56.655248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-0b24bd73-c065-4cb1-bc66-40cc6efa1173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:56.728728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1222/2413] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:56.733828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfe0a-c213-4ca9-b555-c9f21b3ef5b5 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:56.734349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfe0a-c213-4ca9-b555-c9f21b3ef5b5 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:56.734734 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfe0a-c213-4ca9-b555-c9f21b3ef5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:56.790937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-761dfe0a-c213-4ca9-b555-c9f21b3ef5b5 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:56.790937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-761dfe0a-c213-4ca9-b555-c9f21b3ef5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:56.805720 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1192/2414] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:56.809752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24bd73-c065-4cb1-bc66-40cc6efa1173 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:56.826895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24bd73-c065-4cb1-bc66-40cc6efa1173 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:56.833538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:56.834541 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:56.834905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:56.835255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:56.836117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:58:56.836467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:56.838447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:56.856627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1223/2415] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 14:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:58:56.860514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dfe0a-c213-4ca9-b555-c9f21b3ef5b5 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:56.871269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dfe0a-c213-4ca9-b555-c9f21b3ef5b5 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:56.880794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:56.882339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:56.882804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:56.883246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:56.884113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:56.886727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:56.924071 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1193/2416] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 14:58:56 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:58:56.928650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:56.953484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e93a71-db14-40fc-b8af-bfc2a661b7f7 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:57.036543 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:57.037377 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:57.037681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:57.037954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:57.038648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:57.040576 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:57.062875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1224/2417] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 14:58:56 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:58:57.067705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:57.078062 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227791d9-782c-4648-8fc1-730a4823bd02 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:57.083513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:57.084134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:57.084415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:57.084744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:57.085449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:57.088484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:57.105417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1194/2418] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:58:57.106480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:57.120509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9902-e0d1-4dd1-aca1-88771c22ce60 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:57.126265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e847b-5121-4788-b633-fe8054d91137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:57.127277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e847b-5121-4788-b633-fe8054d91137 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:57.127668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e847b-5121-4788-b633-fe8054d91137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:57.128066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e847b-5121-4788-b633-fe8054d91137 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:57.129600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e847b-5121-4788-b633-fe8054d91137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:57.131626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e847b-5121-4788-b633-fe8054d91137 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:57.151029 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1225/2419] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 14:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:58:57.151778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:57.168138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd532ea-88c2-49b0-b3ad-1f24a588cec6 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:57.173463 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:57.175639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:57.176087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:57.176551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] PATH_INFO: `/v3/projects/a5435e45fafe42b49f8c451dec225119/users/cd711eefe0f04371a599e8cc0a6ddf5f/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:57.204336 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5435e45fafe42b49f8c451dec225119, user_id=cd711eefe0f04371a599e8cc0a6ddf5f, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:57.210805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:57.245224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f8e5-cdc4-4129-9e9c-e42c0b2ddd56 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:57.245788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f8e5-cdc4-4129-9e9c-e42c0b2ddd56 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:57.246252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f8e5-cdc4-4129-9e9c-e42c0b2ddd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:57.248345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1195/2420] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 14:58:57 2022] PUT /identity/v3/projects/a5435e45fafe42b49f8c451dec225119/users/cd711eefe0f04371a599e8cc0a6ddf5f/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:58:57.289458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1b54f8e5-cdc4-4129-9e9c-e42c0b2ddd56 None None] MFA Rules not processed for user `cd711eefe0f04371a599e8cc0a6ddf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:57.294715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1b54f8e5-cdc4-4129-9e9c-e42c0b2ddd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:57.310515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:57.397601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1226/2421] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:57.414242 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:58:57.417467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:57.425240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:58:57.502912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda093-ab06-4b64-bdf3-d0148e753f37 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:58:57.508081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea8a99-2132-48c5-bdf1-10df9b270eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:58:57.508929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8a99-2132-48c5-bdf1-10df9b270eea service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:57.509221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8a99-2132-48c5-bdf1-10df9b270eea service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:57.509507 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8a99-2132-48c5-bdf1-10df9b270eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:57.525440 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea8a99-2132-48c5-bdf1-10df9b270eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:58:57.526939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea8a99-2132-48c5-bdf1-10df9b270eea service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:58:57.537637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1196/2422] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:58:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:58:58.377241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e08587-3218-4f23-9298-7a632971f12d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:58.377755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e08587-3218-4f23-9298-7a632971f12d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:58.377852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e08587-3218-4f23-9298-7a632971f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:58.396733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-91e08587-3218-4f23-9298-7a632971f12d None None] MFA Rules not processed for user `0eed26f817524cc292be459f2aaa6f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:58.397919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-91e08587-3218-4f23-9298-7a632971f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:58:58.452512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1227/2423] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:58:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:58:59.934863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf007-f3db-4a2a-90f9-611d6cf6faf6 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:58:59.935484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf007-f3db-4a2a-90f9-611d6cf6faf6 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:58:59.935484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf007-f3db-4a2a-90f9-611d6cf6faf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:58:59.954511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c88cf007-f3db-4a2a-90f9-611d6cf6faf6 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:58:59.955799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c88cf007-f3db-4a2a-90f9-611d6cf6faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:00.016343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1197/2424] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 18 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:59:00.030022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e08587-3218-4f23-9298-7a632971f12d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:59:00.031769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-91e08587-3218-4f23-9298-7a632971f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:00.109242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e08587-3218-4f23-9298-7a632971f12d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:59:00.114759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:59:00.115446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:00.115763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:00.116049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:00.124883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:59:00.126892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:59:00.135817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1228/2425] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:59:01.069696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9bc3-26df-4c9f-a366-5847ea55a0dc None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:01.070185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9bc3-26df-4c9f-a366-5847ea55a0dc None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:01.070300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9bc3-26df-4c9f-a366-5847ea55a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:01.090138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-974d9bc3-26df-4c9f-a366-5847ea55a0dc None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:59:01.091433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-974d9bc3-26df-4c9f-a366-5847ea55a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:01.100226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1198/2426] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:59:01.112384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:59:01.126031 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d4551-1341-49d5-a551-06bb53eaeaf3 service swift] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:59:01.132653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac28b-6da3-495b-af8d-ec1b1ec449f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:59:01.133348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac28b-6da3-495b-af8d-ec1b1ec449f4 service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:01.133635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac28b-6da3-495b-af8d-ec1b1ec449f4 service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:01.133926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac28b-6da3-495b-af8d-ec1b1ec449f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:01.142578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ac28b-6da3-495b-af8d-ec1b1ec449f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:59:01.144183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ac28b-6da3-495b-af8d-ec1b1ec449f4 service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:59:01.152662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1229/2427] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 14:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:59:08.053876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d9bc3-26df-4c9f-a366-5847ea55a0dc None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:59:08.123127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d9bc3-26df-4c9f-a366-5847ea55a0dc None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:59:08.128021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:59:08.129604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:08.129889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:08.130167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] PATH_INFO: `/v3/users/cd711eefe0f04371a599e8cc0a6ddf5f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:08.131368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd711eefe0f04371a599e8cc0a6ddf5f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:59:08.133346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:59:08.187928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd711eefe0f04371a599e8cc0a6ddf5f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.188604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd711eefe0f04371a599e8cc0a6ddf5f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.189794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:08.203141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd711eefe0f04371a599e8cc0a6ddf5f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.211008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd711eefe0f04371a599e8cc0a6ddf5f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.211759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd711eefe0f04371a599e8cc0a6ddf5f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.226327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1199/2428] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 14:59:08 2022] DELETE /identity/v3/users/cd711eefe0f04371a599e8cc0a6ddf5f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:59:08.230866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:08.231387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:08.231484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:08.251129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:59:08.252378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:08.286183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:08.317505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1230/2429] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:59:08.327316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:59:08.328810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:08.396797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda83d-4729-4bd8-a9cf-542a100f90f5 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:59:08.400865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:59:08.401835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:08.402318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:08.402904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:08.413454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:59:08.415355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:59:08.425935 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1200/2430] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:59:08.774325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:59:08.775969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:08.788849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca40c0-3fbe-4027-9538-732c02386672 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:59:08.799883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:59:08.801312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:08.801600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:08.801880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] PATH_INFO: `/v3/projects/a5435e45fafe42b49f8c451dec225119` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:08.803530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5435e45fafe42b49f8c451dec225119)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:59:08.805518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:59:08.868746 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5435e45fafe42b49f8c451dec225119', 'request_id': 'req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.874682 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5435e45fafe42b49f8c451dec225119', 'request_id': 'req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.883608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5435e45fafe42b49f8c451dec225119', 'request_id': 'req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.896641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] The token cache is being invalidate because project a5435e45fafe42b49f8c451dec225119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:59:08.896987 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.897669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4eaaf0d2-2fd2-4265-a372-648e6d108ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:59:08.899570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1231/2431] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 14:59:08 2022] DELETE /identity/v3/projects/a5435e45fafe42b49f8c451dec225119 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:59:18.421198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=38,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:18.892859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:30.788993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:59:30.790419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:30.801404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea975b4-5be7-449d-8233-3b6c719d8a6d service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:59:30.852532 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ee305-af6a-4d2e-b4c2-2f2865987681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:59:30.853174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ee305-af6a-4d2e-b4c2-2f2865987681 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:30.853460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ee305-af6a-4d2e-b4c2-2f2865987681 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:30.853759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ee305-af6a-4d2e-b4c2-2f2865987681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:30.855554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f02ee305-af6a-4d2e-b4c2-2f2865987681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:30.916484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ee305-af6a-4d2e-b4c2-2f2865987681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:59:30.917990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ee305-af6a-4d2e-b4c2-2f2865987681 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:59:30.928238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1201/2432] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 14:59:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:59:40.429703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:40.430199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:40.430318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:40.447911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] MFA Rules not processed for user `2aa34e012c824754833a12ac66413aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:59:40.449140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:40.502558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1232/2433] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:59:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:59:40.923091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=50 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:50.496496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=25 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:59:53.090786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9edf-af56-48eb-bf7b-e1fe066f5784 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:59:53.091306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9edf-af56-48eb-bf7b-e1fe066f5784 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:59:53.091424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9edf-af56-48eb-bf7b-e1fe066f5784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:59:53.109726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d25b9edf-af56-48eb-bf7b-e1fe066f5784 None None] MFA Rules not processed for user `25784e3193b047ecaa6788bd79611f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:59:53.110964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d25b9edf-af56-48eb-bf7b-e1fe066f5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:59:53.169840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1202/2434] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:00:03.163052 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=25 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:38.247880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:38.249398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:38.262341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85d82-8cf2-4d75-8b78-9836bb1cb014 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:38.265959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:38.266600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:38.266888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:38.267170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:38.269024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:38.339262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:38.340860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:38.352631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1233/2435] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:00:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:00:40.786417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b9edf-af56-48eb-bf7b-e1fe066f5784 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:40.796077 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b9edf-af56-48eb-bf7b-e1fe066f5784 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:40.799704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:40.800346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:40.800673 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:40.800962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:40.802770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:40.816067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:40.817535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:40.828936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1203/2436] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:00:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:00:46.679873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:46.688560 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f452e2-0cfd-4f56-ab3e-582df124a91b service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:46.692244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:46.692928 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:46.693218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:46.693497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:46.695759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:46.757556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:46.759491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:46.769231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1234/2437] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:00:50.027032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.029049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:50.043969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319ff5-c094-4514-be54-dc8cf3915cc9 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.048615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.049528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.049934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.050223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] PATH_INFO: `/v3/users/2aa34e012c824754833a12ac66413aaf` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.051418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa34e012c824754833a12ac66413aaf)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.053428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.099660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa34e012c824754833a12ac66413aaf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.100404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa34e012c824754833a12ac66413aaf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.113705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa34e012c824754833a12ac66413aaf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.121208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa34e012c824754833a12ac66413aaf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.121866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-016d836b-812d-4c49-939a-f02337a53e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa34e012c824754833a12ac66413aaf'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.134550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1204/2438] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:00:50 2022] DELETE /identity/v3/users/2aa34e012c824754833a12ac66413aaf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:00:50.314601 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.326121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42654b35-9c0e-4a84-acf9-4007352b5e87 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.388434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.389393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.389679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.389957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] PATH_INFO: `/v3/projects/84835592358a4e188df86896d6015647` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.391138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84835592358a4e188df86896d6015647)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.393049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.415200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:50.438896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84835592358a4e188df86896d6015647', 'request_id': 'req-4de2d936-2eb9-4050-878f-ffe0a3b06a97'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.444364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84835592358a4e188df86896d6015647', 'request_id': 'req-4de2d936-2eb9-4050-878f-ffe0a3b06a97'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.452186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84835592358a4e188df86896d6015647', 'request_id': 'req-4de2d936-2eb9-4050-878f-ffe0a3b06a97'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.463266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] The token cache is being invalidate because project 84835592358a4e188df86896d6015647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:00:50.463558 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.464185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4de2d936-2eb9-4050-878f-ffe0a3b06a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:00:50.465804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1235/2439] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:00:50 2022] DELETE /identity/v3/projects/84835592358a4e188df86896d6015647 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:00:50.470616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07109-0c8b-4687-8298-cb4b8625889e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.470909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07109-0c8b-4687-8298-cb4b8625889e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.471204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07109-0c8b-4687-8298-cb4b8625889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.490587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d7a07109-0c8b-4687-8298-cb4b8625889e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:00:50.491805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d7a07109-0c8b-4687-8298-cb4b8625889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:50.558547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1205/2440] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:00:50.566065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c2bc-6807-461c-8572-bcef46286b74 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.566356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c2bc-6807-461c-8572-bcef46286b74 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.566638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c2bc-6807-461c-8572-bcef46286b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.584487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-afa3c2bc-6807-461c-8572-bcef46286b74 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:00:50.585698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-afa3c2bc-6807-461c-8572-bcef46286b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:50.593505 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1236/2441] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:00:50.597550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07109-0c8b-4687-8298-cb4b8625889e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.607982 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07109-0c8b-4687-8298-cb4b8625889e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.612602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.613263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.613549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.613831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.614577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:00:50.614890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.616494 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.629253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1206/2442] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:00:50.633397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c2bc-6807-461c-8572-bcef46286b74 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.642473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c2bc-6807-461c-8572-bcef46286b74 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.647067 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.647708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.647991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.648290 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.649014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.650903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.679367 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1237/2443] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:00:50 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:00:50.684175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.694189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ea92f-9d9a-4461-957e-caf63e752a5b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.740694 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:50.756916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.757736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.758024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.758299 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.758992 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.760963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.783844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1207/2444] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:00:50 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:00:50.787888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.798937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5676d7-3c9f-48da-80e8-7923da8a7d20 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.803805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.804479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.805396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.805676 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.806410 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.808012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.818802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1238/2445] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:00:50.823855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.835562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9723-3890-42cd-9e00-cf4e2a052756 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.841126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f89d4-1a2f-476c-a2d8-258a82b5a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.841830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f89d4-1a2f-476c-a2d8-258a82b5a844 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.842107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f89d4-1a2f-476c-a2d8-258a82b5a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.842697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f89d4-1a2f-476c-a2d8-258a82b5a844 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.843149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f89d4-1a2f-476c-a2d8-258a82b5a844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.844842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f89d4-1a2f-476c-a2d8-258a82b5a844 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.865797 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1208/2446] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:00:50.866857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:50.878665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9633f0-e40d-48b0-804c-16b598283c6f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:50.887047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:50.888257 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.888713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.889015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] PATH_INFO: `/v3/projects/0d032e462665466d83ab51e9c116d1e0/users/a21b520b8aaa45538f59ceeab4ec9d17/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.910622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d032e462665466d83ab51e9c116d1e0, user_id=a21b520b8aaa45538f59ceeab4ec9d17, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:50.915034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:50.933692 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1239/2447] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:00:50 2022] PUT /identity/v3/projects/0d032e462665466d83ab51e9c116d1e0/users/a21b520b8aaa45538f59ceeab4ec9d17/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:00:50.938660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:50.938963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:50.939252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:50.957320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:00:50.958547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:51.019210 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1209/2448] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:00:51.029217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:51.031041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:51.089142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade9c93-f5b3-4aa5-ba23-885605825b2f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:51.092978 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9e402-4b3e-4722-9999-54a858218ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:51.093627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e402-4b3e-4722-9999-54a858218ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:51.093913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e402-4b3e-4722-9999-54a858218ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:51.094193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9e402-4b3e-4722-9999-54a858218ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:51.103885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9e402-4b3e-4722-9999-54a858218ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:51.105552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9e402-4b3e-4722-9999-54a858218ba1 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:51.115411 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1240/2449] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:00:52.720709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:52.722127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:52.799409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e377b-babd-436c-b6a3-4e3b54337a45 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:52.805779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:52.806434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:52.806722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:52.807006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:52.808832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:52.887688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:52.889737 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:52.906630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1210/2450] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:00:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:00:57.122347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c195-7f20-48c9-aadc-83f6dda8f22b None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:57.122811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c195-7f20-48c9-aadc-83f6dda8f22b None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:57.122919 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935c195-7f20-48c9-aadc-83f6dda8f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:57.174396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d935c195-7f20-48c9-aadc-83f6dda8f22b None None] MFA Rules not processed for user `a21b520b8aaa45538f59ceeab4ec9d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:00:57.176196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d935c195-7f20-48c9-aadc-83f6dda8f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:57.258888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:57.324703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1241/2451] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:00:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:00:57.342756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:00:57.344449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:57.355214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:00:57.361627 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e08bf-e28b-4a89-a97d-ffdabe6f7259 service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:00:57.376018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:00:57.376791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:57.377251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:57.377684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:57.389129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:00:57.390971 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:00:57.402423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1211/2452] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:00:59.384945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721433-a8be-424d-9949-ec646ae17162 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:00:59.385865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721433-a8be-424d-9949-ec646ae17162 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:00:59.386197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86721433-a8be-424d-9949-ec646ae17162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:00:59.421193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-86721433-a8be-424d-9949-ec646ae17162 None None] MFA Rules not processed for user `a21b520b8aaa45538f59ceeab4ec9d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:00:59.422698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-86721433-a8be-424d-9949-ec646ae17162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:00:59.431823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1242/2453] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:00.056537 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:00.058020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:00.069871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eb409-b66e-443d-9758-481d93e4e15d service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:00.074472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:00.075209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:00.075501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:00.075779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:00.078304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:00.088281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:00.089805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:00.098237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1212/2454] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:00.257938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1ff9-9991-4408-bc35-177bbba4e67a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:00.258317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1ff9-9991-4408-bc35-177bbba4e67a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:00.258647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1ff9-9991-4408-bc35-177bbba4e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:00.276886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-eb0d1ff9-9991-4408-bc35-177bbba4e67a None None] MFA Rules not processed for user `88c71f6ddf364c9baca69e459547ab02`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:00.278196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-eb0d1ff9-9991-4408-bc35-177bbba4e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:00.336236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1243/2455] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:00.485414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:00.487228 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:00.562263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f8bd3-62ff-447e-a0cf-8bc4b0abb254 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:00.567390 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:00.568042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:00.568327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:00.568830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:00.570609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:00.582604 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:00.584211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:00.594648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1213/2456] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:00.676192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d1ff9-9991-4408-bc35-177bbba4e67a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:00.687729 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d1ff9-9991-4408-bc35-177bbba4e67a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:00.691745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:00.692356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:00.692719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:00.693038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:00.695996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:00.707950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:00.709716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:00.719127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1244/2457] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:02.951437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:02.962493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc930cb7-e9fe-4327-b942-019b89f7a8b8 service placement] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:02.966434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:02.967361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:02.967784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:02.968166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:02.970328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:02.981392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:02.983023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:02.993186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1214/2458] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:04.256389 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:04.278149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc622e48-16e9-4649-8e16-342cbcb0f560 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:04.285062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed78fec-02cc-4b57-8933-d27d8c3272b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:04.285948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed78fec-02cc-4b57-8933-d27d8c3272b7 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:04.286451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed78fec-02cc-4b57-8933-d27d8c3272b7 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:04.286929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed78fec-02cc-4b57-8933-d27d8c3272b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:04.289222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-aed78fec-02cc-4b57-8933-d27d8c3272b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:04.315845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed78fec-02cc-4b57-8933-d27d8c3272b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:04.317904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed78fec-02cc-4b57-8933-d27d8c3272b7 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:04.344574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1245/2459] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:07.092236 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:07.106387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f7e00-0597-41d6-a15c-7849e1d12062 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:07.112576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01ae2b-cd65-471f-80e9-0b5eac6e1e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:07.113269 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01ae2b-cd65-471f-80e9-0b5eac6e1e21 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:07.113584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01ae2b-cd65-471f-80e9-0b5eac6e1e21 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:07.113899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01ae2b-cd65-471f-80e9-0b5eac6e1e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:07.116165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4c01ae2b-cd65-471f-80e9-0b5eac6e1e21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:07.129332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01ae2b-cd65-471f-80e9-0b5eac6e1e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:07.130945 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01ae2b-cd65-471f-80e9-0b5eac6e1e21 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:07.142059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1215/2460] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:10.702934 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c3893-6f93-4e79-b523-b9472f559348 None None] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:10.703467 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c3893-6f93-4e79-b523-b9472f559348 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:10.703623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c3893-6f93-4e79-b523-b9472f559348 None None] PATH_INFO: `/` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:10.705107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1246/2461] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 15:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 15:01:10.712251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452a7b-d468-4e78-8c3d-506153bae7ce None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:10.712785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452a7b-d468-4e78-8c3d-506153bae7ce None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:10.712870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452a7b-d468-4e78-8c3d-506153bae7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:10.731074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-51452a7b-d468-4e78-8c3d-506153bae7ce None None] MFA Rules not processed for user `1aa975bb70624500aa802e7a708014c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:10.732339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-51452a7b-d468-4e78-8c3d-506153bae7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:10.739890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1216/2462] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 15:01:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:10.752161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c3893-6f93-4e79-b523-b9472f559348 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:10.763825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c3893-6f93-4e79-b523-b9472f559348 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:10.767441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb015410-12dd-42c8-a6da-152af34ff3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:10.768113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb015410-12dd-42c8-a6da-152af34ff3cd service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:10.768440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb015410-12dd-42c8-a6da-152af34ff3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:10.768787 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb015410-12dd-42c8-a6da-152af34ff3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:10.777630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb015410-12dd-42c8-a6da-152af34ff3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:10.779094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb015410-12dd-42c8-a6da-152af34ff3cd service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:10.787194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1247/2463] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:10.879179 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f953-e720-4921-95a6-95912201fdbf None None] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:10.879471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f953-e720-4921-95a6-95912201fdbf None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:10.879754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f953-e720-4921-95a6-95912201fdbf None None] PATH_INFO: `/` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:10.881320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1217/2464] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 18 15:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 15:01:10.887976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861157e-c333-44a5-a729-4745ebad08ab None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:10.888540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861157e-c333-44a5-a729-4745ebad08ab None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:10.889113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861157e-c333-44a5-a729-4745ebad08ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:10.914150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b861157e-c333-44a5-a729-4745ebad08ab None None] MFA Rules not processed for user `06274e1b42f6471cac81889ec673a222`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:10.916149 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b861157e-c333-44a5-a729-4745ebad08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:10.928301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1248/2465] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 18 15:01:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:10.938965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f953-e720-4921-95a6-95912201fdbf None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:10.951593 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f953-e720-4921-95a6-95912201fdbf None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:10.955653 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362554a8-fd7d-41ae-91a4-4a11af2a06ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:10.956450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362554a8-fd7d-41ae-91a4-4a11af2a06ec service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:10.956987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362554a8-fd7d-41ae-91a4-4a11af2a06ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:10.957271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362554a8-fd7d-41ae-91a4-4a11af2a06ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:10.969885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362554a8-fd7d-41ae-91a4-4a11af2a06ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:10.971509 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362554a8-fd7d-41ae-91a4-4a11af2a06ec service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:10.984303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1218/2466] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:01:14.265698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861157e-c333-44a5-a729-4745ebad08ab None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:14.283380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861157e-c333-44a5-a729-4745ebad08ab None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:14.293325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:14.294039 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:14.294365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:14.294886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:14.296992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:14.311158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:14.312813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:14.324962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1249/2467] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:16.170196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30e69-30b0-4419-b6ee-f153bd46e1b4 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:16.170769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30e69-30b0-4419-b6ee-f153bd46e1b4 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:16.170769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30e69-30b0-4419-b6ee-f153bd46e1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:16.207302 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-bce30e69-30b0-4419-b6ee-f153bd46e1b4 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:16.209862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bce30e69-30b0-4419-b6ee-f153bd46e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:16.272903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1219/2468] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:16.324005 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:16.326444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:16.414518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ad97-fec8-4a7a-8de6-00818557d228 service nova] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:16.419425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:16.420091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:16.420413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:16.420767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:16.428812 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:16.430655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:16.438710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1250/2469] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 15:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 15:01:17.650444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:17.651477 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:17.651924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:17.689767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:17.691289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:17.707567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1220/2470] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 18 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:17.718346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:17.733762 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361378ac-cd12-4d60-b4a0-812cb14d947b service swift] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:17.745513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:17.746281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:17.746842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:17.747243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:17.754365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:17.759662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:17.761302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:17.771177 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1251/2471] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 15:01:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 15:01:27.556815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:27.560898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:27.570206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=93 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:27.577346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1fbab-bf18-4cd0-9bcc-9145003a6747 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:27.583610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:27.584499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:27.584841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:27.585659 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] PATH_INFO: `/v3/users/0eed26f817524cc292be459f2aaa6f6e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:27.586900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eed26f817524cc292be459f2aaa6f6e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:27.588864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:27.635761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eed26f817524cc292be459f2aaa6f6e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:27.636476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eed26f817524cc292be459f2aaa6f6e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:27.648878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eed26f817524cc292be459f2aaa6f6e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:27.655563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eed26f817524cc292be459f2aaa6f6e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:27.656223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eed26f817524cc292be459f2aaa6f6e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:27.670425 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1221/2472] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:01:27 2022] DELETE /identity/v3/users/0eed26f817524cc292be459f2aaa6f6e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:01:27.767093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:27.846021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:27.858818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7538f-0bde-4123-88ca-05961e93e557 service swift] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:27.923473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:27.924362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:27.924722 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:27.925030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] PATH_INFO: `/v3/projects/51aa9f371a9c4b20bd52f8e251c80711` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:27.926234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51aa9f371a9c4b20bd52f8e251c80711)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:27.928297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:27.978014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51aa9f371a9c4b20bd52f8e251c80711', 'request_id': 'req-962ac456-6bb6-4589-b748-9854df852043'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:27.983679 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51aa9f371a9c4b20bd52f8e251c80711', 'request_id': 'req-962ac456-6bb6-4589-b748-9854df852043'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:27.992428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51aa9f371a9c4b20bd52f8e251c80711', 'request_id': 'req-962ac456-6bb6-4589-b748-9854df852043'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.004957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] The token cache is being invalidate because project 51aa9f371a9c4b20bd52f8e251c80711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:01:28.005365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.006075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.007664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1252/2473] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:01:27 2022] DELETE /identity/v3/projects/51aa9f371a9c4b20bd52f8e251c80711 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:01:28.011699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.013541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:28.028661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8508-8d1d-465c-9484-dc17451d6efb admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.093201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.094195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.094485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.094766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] PATH_INFO: `/v3/users/b451417795c540e1b28874f159b34e3e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.096158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b451417795c540e1b28874f159b34e3e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:28.098349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:28.174736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b451417795c540e1b28874f159b34e3e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.175573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b451417795c540e1b28874f159b34e3e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.199072 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b451417795c540e1b28874f159b34e3e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.212825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b451417795c540e1b28874f159b34e3e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.213943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-c4125c0a-82f7-409f-a8e9-eafe1dce4421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b451417795c540e1b28874f159b34e3e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.219811 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:28.245219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1222/2474] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:01:28 2022] DELETE /identity/v3/users/b451417795c540e1b28874f159b34e3e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:01:28.431937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.433759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:28.451168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac456-6bb6-4589-b748-9854df852043 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.517598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.518482 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.518803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.519101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] PATH_INFO: `/v3/projects/a5cf3ef49d7342e7938fcecf26730db7` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.520325 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5cf3ef49d7342e7938fcecf26730db7)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:28.522862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:28.557212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:28.570061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5cf3ef49d7342e7938fcecf26730db7', 'request_id': 'req-c658c6c0-539d-4def-ade8-96f0ed1098bb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.575502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5cf3ef49d7342e7938fcecf26730db7', 'request_id': 'req-c658c6c0-539d-4def-ade8-96f0ed1098bb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.582022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5cf3ef49d7342e7938fcecf26730db7', 'request_id': 'req-c658c6c0-539d-4def-ade8-96f0ed1098bb'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.594687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] The token cache is being invalidate because project a5cf3ef49d7342e7938fcecf26730db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:01:28.594980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.595625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-c658c6c0-539d-4def-ade8-96f0ed1098bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:01:28.597201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1253/2475] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:01:28 2022] DELETE /identity/v3/projects/a5cf3ef49d7342e7938fcecf26730db7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:01:28.604218 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186342f2-817d-435b-86c4-f54832b2b7fd None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.605163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186342f2-817d-435b-86c4-f54832b2b7fd None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.605424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186342f2-817d-435b-86c4-f54832b2b7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.623303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-186342f2-817d-435b-86c4-f54832b2b7fd None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:28.624518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-186342f2-817d-435b-86c4-f54832b2b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:28.685781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1223/2476] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:28.694044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b90d-16bc-4641-8a73-4dcacfc1022e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.694880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b90d-16bc-4641-8a73-4dcacfc1022e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.695215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b90d-16bc-4641-8a73-4dcacfc1022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.714124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-da40b90d-16bc-4641-8a73-4dcacfc1022e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:28.715340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-da40b90d-16bc-4641-8a73-4dcacfc1022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:28.723469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1254/2477] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:28.727700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186342f2-817d-435b-86c4-f54832b2b7fd None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.737581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186342f2-817d-435b-86c4-f54832b2b7fd None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.742365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.742966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.743255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.743538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.744300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:01:28.744642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:28.746256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:28.758871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1224/2478] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:01:28.763063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b90d-16bc-4641-8a73-4dcacfc1022e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.773255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b90d-16bc-4641-8a73-4dcacfc1022e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.778002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.778669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.778951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.779230 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.779922 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:28.781852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:28.806858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1255/2479] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:01:28 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:01:28.810987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.821578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ea5e2-ca64-4b20-b46f-01405a364863 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.879678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.880354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.880671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.880955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.881652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:28.884088 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:28.908201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1225/2480] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:01:28 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:01:28.911986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.922440 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa8d50-99f9-4135-8533-f4a94c3c7d0b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.928194 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.928907 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.929626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.929904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.930672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:28.932296 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:28.943190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1256/2481] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:01:28.947563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.957445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110ae98-4977-4923-9559-7db7cf6b2d9e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.962624 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd2a8-f8cf-4d02-847f-1bdb19156c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.963286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd2a8-f8cf-4d02-847f-1bdb19156c5a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.963574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd2a8-f8cf-4d02-847f-1bdb19156c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.963857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd2a8-f8cf-4d02-847f-1bdb19156c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:28.964622 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd2a8-f8cf-4d02-847f-1bdb19156c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:28.966216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd2a8-f8cf-4d02-847f-1bdb19156c5a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:28.976145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1226/2482] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:01:28.980035 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:28.990107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff313-6446-4527-9a25-b45367b45970 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:28.994884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:28.995701 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:28.995984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:28.996261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] PATH_INFO: `/v3/projects/d2f3dc5d9c6648c79267f71b5a86f249/users/b1a4f9ee8de446fe989b4d91ea0315e8/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:29.012775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f3dc5d9c6648c79267f71b5a86f249, user_id=b1a4f9ee8de446fe989b4d91ea0315e8, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:29.015428 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:29.028520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1257/2483] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:01:28 2022] PUT /identity/v3/projects/d2f3dc5d9c6648c79267f71b5a86f249/users/b1a4f9ee8de446fe989b4d91ea0315e8/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:01:29.033526 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f216b5-5553-4c55-97d4-67ecf44b7127 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:29.033821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f216b5-5553-4c55-97d4-67ecf44b7127 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:29.034107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f216b5-5553-4c55-97d4-67ecf44b7127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:29.051699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-11f216b5-5553-4c55-97d4-67ecf44b7127 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:29.052934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-11f216b5-5553-4c55-97d4-67ecf44b7127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:29.104647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:29.115251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1227/2484] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:29.125141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:29.126828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:29.182513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad01e2-3aac-4b28-9ae6-f5548049621b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:29.186144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:29.186781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:29.187068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:29.187352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:29.197139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:29.198563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:29.207945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1258/2485] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:34.131253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97bd0a-4113-4b5c-b340-4396407b7b61 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:34.131832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97bd0a-4113-4b5c-b340-4396407b7b61 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:34.131919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97bd0a-4113-4b5c-b340-4396407b7b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:34.159359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1e97bd0a-4113-4b5c-b340-4396407b7b61 None None] MFA Rules not processed for user `b1a4f9ee8de446fe989b4d91ea0315e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:34.160786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1e97bd0a-4113-4b5c-b340-4396407b7b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:34.227723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1228/2486] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:34.232281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:34.242622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f54b3f-4fe3-4837-b071-98fdafbc08f0 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:34.247508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:34.248162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:34.248571 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:34.249032 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:34.249726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:34.251624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:34.283926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1259/2487] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:01:34 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:01:34.288368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97bd0a-4113-4b5c-b340-4396407b7b61 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:34.301491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97bd0a-4113-4b5c-b340-4396407b7b61 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:34.365161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:34.365845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:34.366162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:34.366454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:34.367149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:34.369108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:34.389686 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1229/2488] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:01:34 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:01:34.393664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:34.405128 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeced3-331f-4644-817f-063cbbd87367 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:34.409913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:34.410583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:34.410872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:34.411158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:34.411886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:34.414291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:34.425402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1260/2489] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:01:34.429580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:34.440480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2a0f-026e-406d-b6fc-0b7d6b9a29b4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:34.445506 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:34.446438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:34.446743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:34.447014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] PATH_INFO: `/v3/projects/e79bc9f8860a4c9a868621d4359c8097/users/46ef905ab0e44227bff55b4074de59d2/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:34.463022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79bc9f8860a4c9a868621d4359c8097, user_id=46ef905ab0e44227bff55b4074de59d2, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:34.465741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:34.479346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1230/2490] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:01:34 2022] PUT /identity/v3/projects/e79bc9f8860a4c9a868621d4359c8097/users/46ef905ab0e44227bff55b4074de59d2/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:01:34.483265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:34.493280 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b262e-dd76-427f-bf0d-62573d567740 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:34.519760 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:34.555581 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505a77-3d4f-438e-a490-d9810337b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:34.556258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505a77-3d4f-438e-a490-d9810337b488 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:34.556548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505a77-3d4f-438e-a490-d9810337b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:34.556864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505a77-3d4f-438e-a490-d9810337b488 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:34.559650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505a77-3d4f-438e-a490-d9810337b488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:34.561315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505a77-3d4f-438e-a490-d9810337b488 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:34.573999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1261/2491] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:01:34.578468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:34.592763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b70ef-7912-4828-9fad-6bf56c54db0b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:34.597615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:34.598615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:34.598912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:34.599191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] PATH_INFO: `/v3/projects/e79bc9f8860a4c9a868621d4359c8097/users/46ef905ab0e44227bff55b4074de59d2/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:34.601873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79bc9f8860a4c9a868621d4359c8097, user_id=46ef905ab0e44227bff55b4074de59d2, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:34.604636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:34.615504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1231/2492] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:01:34 2022] PUT /identity/v3/projects/e79bc9f8860a4c9a868621d4359c8097/users/46ef905ab0e44227bff55b4074de59d2/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:01:36.059799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147407-6f2b-430f-b742-618f9534c841 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:36.060618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147407-6f2b-430f-b742-618f9534c841 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:36.061224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75147407-6f2b-430f-b742-618f9534c841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:36.091058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-75147407-6f2b-430f-b742-618f9534c841 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:36.093167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-75147407-6f2b-430f-b742-618f9534c841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:36.172226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1262/2493] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 18 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:36.192101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:36.194709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:36.280225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:36.339767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435551e7-4eb6-4604-adba-a7646bd39318 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:36.352095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:36.353272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:36.353786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:36.354930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:36.370545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:36.372384 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:36.384444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1232/2494] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 15:01:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 15:01:41.193281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b525-8bd8-4a80-b2e5-6e06017731ea None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:41.193733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b525-8bd8-4a80-b2e5-6e06017731ea None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:41.194753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b525-8bd8-4a80-b2e5-6e06017731ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:41.243779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8937b525-8bd8-4a80-b2e5-6e06017731ea None None] MFA Rules not processed for user `46ef905ab0e44227bff55b4074de59d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:41.246402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8937b525-8bd8-4a80-b2e5-6e06017731ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:41.425745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1263/2495] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:41.433404 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:41.434882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:41.525308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3fae8-8c87-44c0-a177-ec3980f497ed service swift] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:41.531806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:41.532478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:41.532836 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:41.533120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:41.626365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:41.628227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:41.645483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1233/2496] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:01:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:01:51.406362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=76 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:51.634977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=69 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:01:54.586484 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdce86-33f4-4e1c-b1a3-e1055a9cee96 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:54.586958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdce86-33f4-4e1c-b1a3-e1055a9cee96 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:54.587240 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdce86-33f4-4e1c-b1a3-e1055a9cee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:54.604453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8dfdce86-33f4-4e1c-b1a3-e1055a9cee96 None None] MFA Rules not processed for user `45668b6b20b644689d57844dc6b77ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:54.605674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8dfdce86-33f4-4e1c-b1a3-e1055a9cee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:54.612707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1264/2497] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 18 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:01:54.625436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:01:54.636617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df1e88-a1c6-412e-a851-c82131cf7b5b service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:01:54.641544 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2c1ef0b6b3241a19397b8696c05fc99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:01:54.642175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:54.642456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:54.642756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:54.651432 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:01:54.653567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:01:54.662109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1234/2498] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 18 15:01:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 15:01:59.479713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6dfa-4aa5-45e7-bc91-23e214e1fda5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:01:59.480207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6dfa-4aa5-45e7-bc91-23e214e1fda5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:01:59.480207 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6dfa-4aa5-45e7-bc91-23e214e1fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:01:59.497273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5dda6dfa-4aa5-45e7-bc91-23e214e1fda5 None None] MFA Rules not processed for user `b1a4f9ee8de446fe989b4d91ea0315e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:01:59.498445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5dda6dfa-4aa5-45e7-bc91-23e214e1fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:01:59.505228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1265/2499] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:01:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:04.658869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=6 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:09.492095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=6 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:12.570502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:12.571938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:12.628160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde71f4-352e-4e84-a9ee-99dedf64ce07 service swift] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:12.631761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:12.632398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:12.632712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:12.632994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:12.634727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:12.691525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:12.693036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:12.701838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1235/2500] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:16.743489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671241c4-38d6-4538-af86-cf57a934bf63 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:16.744059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671241c4-38d6-4538-af86-cf57a934bf63 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:16.744165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671241c4-38d6-4538-af86-cf57a934bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:16.763937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-671241c4-38d6-4538-af86-cf57a934bf63 None None] MFA Rules not processed for user `a21b520b8aaa45538f59ceeab4ec9d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:16.765160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-671241c4-38d6-4538-af86-cf57a934bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:16.827766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1266/2501] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:20.697591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:20.752706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d65a7-6014-424f-8242-54134c3a38f6 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:20.756322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:20.756991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:20.757273 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:20.757547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:20.766365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:20.767791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:20.777035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1236/2502] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:26.821486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=25 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:30.772978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=74 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:35.801827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671241c4-38d6-4538-af86-cf57a934bf63 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:35.812014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671241c4-38d6-4538-af86-cf57a934bf63 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:35.815534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:35.816167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:35.816448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:35.816755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:35.819166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:35.883427 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:35.884921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:35.894798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1267/2503] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:39.474153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:39.475747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:39.489815 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f2bd3-0464-417d-b21f-451431b6740a service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:39.494920 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:39.495825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:39.496112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:39.496391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] PATH_INFO: `/v3/users/88c71f6ddf364c9baca69e459547ab02` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:39.497610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c71f6ddf364c9baca69e459547ab02)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:39.499561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:39.546628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c71f6ddf364c9baca69e459547ab02'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.547287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c71f6ddf364c9baca69e459547ab02'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.559980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c71f6ddf364c9baca69e459547ab02'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.566806 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c71f6ddf364c9baca69e459547ab02'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.567449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-1c373639-72be-4786-99a5-fabb098b15ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c71f6ddf364c9baca69e459547ab02'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.583001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1237/2504] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:39 2022] DELETE /identity/v3/users/88c71f6ddf364c9baca69e459547ab02 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:39.773085 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:39.783448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08612-513a-469e-b353-4072c74c8f49 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:39.841495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:39.842361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:39.842665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:39.842973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] PATH_INFO: `/v3/projects/c9a08f2c9b8b49f6a5de343bf8826601` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:39.844174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a08f2c9b8b49f6a5de343bf8826601)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:39.846101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:39.893254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a08f2c9b8b49f6a5de343bf8826601', 'request_id': 'req-2ea00797-dda2-4439-a3e4-6b969997f0b9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.898662 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a08f2c9b8b49f6a5de343bf8826601', 'request_id': 'req-2ea00797-dda2-4439-a3e4-6b969997f0b9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.905898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a08f2c9b8b49f6a5de343bf8826601', 'request_id': 'req-2ea00797-dda2-4439-a3e4-6b969997f0b9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.917262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] The token cache is being invalidate because project c9a08f2c9b8b49f6a5de343bf8826601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:39.917553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.918183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2ea00797-dda2-4439-a3e4-6b969997f0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:39.919700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1268/2505] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:39 2022] DELETE /identity/v3/projects/c9a08f2c9b8b49f6a5de343bf8826601 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:39.924691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02e3fa-225e-4b69-8fee-28adac94151b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:39.924991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02e3fa-225e-4b69-8fee-28adac94151b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:39.925308 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02e3fa-225e-4b69-8fee-28adac94151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:39.944015 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-7f02e3fa-225e-4b69-8fee-28adac94151b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:39.945314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7f02e3fa-225e-4b69-8fee-28adac94151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:40.007237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1238/2506] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:40.015477 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2b4e-320a-4c64-b086-f198d23ffd18 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.015813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2b4e-320a-4c64-b086-f198d23ffd18 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.016078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2b4e-320a-4c64-b086-f198d23ffd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.039610 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-216f2b4e-320a-4c64-b086-f198d23ffd18 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:40.040893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-216f2b4e-320a-4c64-b086-f198d23ffd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:40.049439 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1269/2507] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:40.054646 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02e3fa-225e-4b69-8fee-28adac94151b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:40.066405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02e3fa-225e-4b69-8fee-28adac94151b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:40.073051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:40.073732 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.074020 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.074297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.075024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:40.075335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:40.076981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:40.088989 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1239/2508] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:40.093845 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f2b4e-320a-4c64-b086-f198d23ffd18 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:40.103148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f2b4e-320a-4c64-b086-f198d23ffd18 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:40.108112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:40.108795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.109079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.109353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.110076 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:40.111981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:40.128771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:40.151860 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1270/2509] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:40 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:40.155846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:40.165626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e14885-ae8b-4ef7-b203-dbc97c3014f3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:40.222599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:40.223279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.223571 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.223856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.224648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:40.226648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:40.233370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:40.248810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1240/2510] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:40 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:40.252862 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:40.263577 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd66e33-fee5-477e-9ef3-6479a8453d83 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:40.268237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:40.268950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.269241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.269532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.270259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:40.271864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:40.281731 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1271/2511] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:40.285563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:40.295175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1878-0125-4e2b-b3e9-04dd85eaeb2b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:40.299934 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab140a-7092-4f71-81aa-7d4c0672a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:40.300658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab140a-7092-4f71-81aa-7d4c0672a2ad admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.300951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab140a-7092-4f71-81aa-7d4c0672a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.301235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab140a-7092-4f71-81aa-7d4c0672a2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.301964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab140a-7092-4f71-81aa-7d4c0672a2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:40.304189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab140a-7092-4f71-81aa-7d4c0672a2ad admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:40.317377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1241/2512] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:40.319020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:40.328992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dea4f7-f0f8-4579-90b8-fbbb05778e63 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:40.333686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:40.334600 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.334888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.335172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] PATH_INFO: `/v3/projects/289a1185e9aa410c8c311056e63feb99/users/484b694919df45bfa9b4287c9af0fae4/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.350446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=289a1185e9aa410c8c311056e63feb99, user_id=484b694919df45bfa9b4287c9af0fae4, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:40.353115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:40.366140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1272/2513] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:40 2022] PUT /identity/v3/projects/289a1185e9aa410c8c311056e63feb99/users/484b694919df45bfa9b4287c9af0fae4/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:40.376669 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.376967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.377252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.404873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] MFA Rules not processed for user `484b694919df45bfa9b4287c9af0fae4`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:40.406103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:40.474319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1242/2514] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:40.486364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:40.488314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:40.554017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a315249-8484-4951-b1bc-5e0dd146be2c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:40.558400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:40.559063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:40.559350 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:40.559637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:40.568694 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:40.570129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:40.579376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1273/2515] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:41.750674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:41.752085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:41.808037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83199560-7ae0-4387-98a5-6d11e7d40573 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:41.811597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:41.812241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:41.812528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:41.812838 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:41.814595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:41.878687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:41.880145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:41.890615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1243/2516] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:44.853156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:44.855394 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:44.871354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba08d3-22d5-473b-bf77-9fc5879e4f19 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:44.876423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:44.877771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:44.878302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:44.878754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] PATH_INFO: `/v3/users/25784e3193b047ecaa6788bd79611f3f` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:44.880053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25784e3193b047ecaa6788bd79611f3f)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:44.882048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:44.946903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25784e3193b047ecaa6788bd79611f3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:44.955295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25784e3193b047ecaa6788bd79611f3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:44.967161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25784e3193b047ecaa6788bd79611f3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:44.968015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25784e3193b047ecaa6788bd79611f3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:44.968714 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-57e9a188-b320-49b7-9dd5-b4d3c4b36d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25784e3193b047ecaa6788bd79611f3f'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:44.984495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1274/2517] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:44 2022] DELETE /identity/v3/users/25784e3193b047ecaa6788bd79611f3f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:45.201809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.221910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adae2f-3857-4ab7-92b4-bc2e1a77f5ca service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:45.237907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:45.294045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:45.294921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.295209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.295489 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] PATH_INFO: `/v3/projects/9c46dc2b21d34158bf2a7eb0e39c06a3` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.296754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c46dc2b21d34158bf2a7eb0e39c06a3)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:45.298721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:45.352120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'request_id': 'req-e2ae8d4c-905e-4658-9add-51ac60be2e9f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:45.362619 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'request_id': 'req-e2ae8d4c-905e-4658-9add-51ac60be2e9f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:45.373626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c46dc2b21d34158bf2a7eb0e39c06a3', 'request_id': 'req-e2ae8d4c-905e-4658-9add-51ac60be2e9f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:45.389232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] The token cache is being invalidate because project 9c46dc2b21d34158bf2a7eb0e39c06a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:45.389501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:45.390444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e2ae8d4c-905e-4658-9add-51ac60be2e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:45.392623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1244/2518] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:45 2022] DELETE /identity/v3/projects/9c46dc2b21d34158bf2a7eb0e39c06a3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:45.397972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf7ad-d58b-444f-99fc-953fb650e456 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.398253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf7ad-d58b-444f-99fc-953fb650e456 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.398542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf7ad-d58b-444f-99fc-953fb650e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.418057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-28adf7ad-d58b-444f-99fc-953fb650e456 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:45.419373 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-28adf7ad-d58b-444f-99fc-953fb650e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:45.441880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:45.482866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1275/2519] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:45.491129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7589af-2069-403b-9854-392e8f491730 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.491495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7589af-2069-403b-9854-392e8f491730 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.491771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7589af-2069-403b-9854-392e8f491730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.510205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1e7589af-2069-403b-9854-392e8f491730 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:45.511402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1e7589af-2069-403b-9854-392e8f491730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:45.523448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1245/2520] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:45.527526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf7ad-d58b-444f-99fc-953fb650e456 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.538244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf7ad-d58b-444f-99fc-953fb650e456 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:45.542917 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:45.543576 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.543873 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.544142 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.544901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:45.545210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:45.546781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:45.558872 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1276/2521] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:45.563679 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7589af-2069-403b-9854-392e8f491730 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.573569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7589af-2069-403b-9854-392e8f491730 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:45.580059 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:45.580883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.581241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.581582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.582364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:45.585000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:45.611016 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1246/2522] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:45 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:45.621414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.627042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ad1a-9b38-4f51-96f4-14c80bdda9f1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:45.690952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:45.691850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.692234 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.692511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.693767 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:45.695939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:45.720778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1277/2523] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:45 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:45.722147 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.732812 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883e81a-0572-4028-8645-df4fac801e3b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:45.737488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:45.738145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.738426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.738700 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.739417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:45.741111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:45.751459 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1247/2524] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:45.755418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.767077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4f10-060b-4a6a-9e8e-38bbfabbccd3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:45.772421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e8c09-ba09-43e1-983e-a50f15305a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:45.773112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8c09-ba09-43e1-983e-a50f15305a33 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.773435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8c09-ba09-43e1-983e-a50f15305a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.773716 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8c09-ba09-43e1-983e-a50f15305a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.774447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e8c09-ba09-43e1-983e-a50f15305a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:45.776050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e8c09-ba09-43e1-983e-a50f15305a33 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:45.786657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1278/2525] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:45.790781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.800698 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464aae0-aae8-49e0-8fb1-4435226230c1 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:45.805647 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:45.806523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.806802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.807080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] PATH_INFO: `/v3/projects/ccc6fb03419d4d93bd22905df7654009/users/f78eb0eb9f8b4c4fb59000fece6be820/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.821726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc6fb03419d4d93bd22905df7654009, user_id=f78eb0eb9f8b4c4fb59000fece6be820, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:45.824377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:45.837670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1248/2526] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:45 2022] PUT /identity/v3/projects/ccc6fb03419d4d93bd22905df7654009/users/f78eb0eb9f8b4c4fb59000fece6be820/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:45.848258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46a23-93b3-4bce-952b-794fe32146d2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:45.848548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46a23-93b3-4bce-952b-794fe32146d2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:45.848859 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46a23-93b3-4bce-952b-794fe32146d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:45.873948 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8bd46a23-93b3-4bce-952b-794fe32146d2 None None] MFA Rules not processed for user `f78eb0eb9f8b4c4fb59000fece6be820`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:45.875137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8bd46a23-93b3-4bce-952b-794fe32146d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:45.942852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1279/2527] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:45.947522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:45.996791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:46.014310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e26f4-bc9b-45ef-81a8-9fe091e9b598 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.019172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.019840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.020130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.020412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.021144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.023570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.052448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1249/2528] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:45 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:46.053851 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46a23-93b3-4bce-952b-794fe32146d2 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.064733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46a23-93b3-4bce-952b-794fe32146d2 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.082407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:46.122641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.123414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.123710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.123992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.124737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.126672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.147549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1280/2529] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:46 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:46.151625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.161999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481f68-f570-4ef8-b360-a2a38c8e6d47 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.167284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.167937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.168225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.168504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.169261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.170859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.182508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1250/2530] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:46.186517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.196686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dde250-6b1e-46ca-a9ce-a0fbc6c4e2d9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.201236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.202109 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.202392 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.202673 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] PATH_INFO: `/v3/projects/2fc99e5607a54cac8b232ae46301983d/users/f49973fe5d7242c6bbe95379e9a20d92/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.217789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc99e5607a54cac8b232ae46301983d, user_id=f49973fe5d7242c6bbe95379e9a20d92, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.220417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.234235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1281/2531] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:46 2022] PUT /identity/v3/projects/2fc99e5607a54cac8b232ae46301983d/users/f49973fe5d7242c6bbe95379e9a20d92/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:46.238240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.248335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b463f7-ea2f-4cd6-836f-8de66772986a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.304372 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c2d10-d802-41d3-a398-94ce6d361cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.305073 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c2d10-d802-41d3-a398-94ce6d361cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.305615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c2d10-d802-41d3-a398-94ce6d361cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.305897 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c2d10-d802-41d3-a398-94ce6d361cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.306615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c2d10-d802-41d3-a398-94ce6d361cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.308232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c2d10-d802-41d3-a398-94ce6d361cb5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.317798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1251/2532] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:46.322532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.332631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0823ee-63e8-4e63-a8b5-07682d113cca admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.337755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.338626 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.338908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.339183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] PATH_INFO: `/v3/projects/2fc99e5607a54cac8b232ae46301983d/users/f49973fe5d7242c6bbe95379e9a20d92/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.341151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc99e5607a54cac8b232ae46301983d, user_id=f49973fe5d7242c6bbe95379e9a20d92, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.343748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.353805 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1282/2533] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:46 2022] PUT /identity/v3/projects/2fc99e5607a54cac8b232ae46301983d/users/f49973fe5d7242c6bbe95379e9a20d92/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:46.363466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9a4bf-3f7d-440f-9af0-82263ef8742e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.363761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9a4bf-3f7d-440f-9af0-82263ef8742e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.364048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9a4bf-3f7d-440f-9af0-82263ef8742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.390381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-04c9a4bf-3f7d-440f-9af0-82263ef8742e None None] MFA Rules not processed for user `f49973fe5d7242c6bbe95379e9a20d92`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:46.391611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-04c9a4bf-3f7d-440f-9af0-82263ef8742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:46.457548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1252/2534] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:46.468655 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.470340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:46.525268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc51ca-cf83-4848-9605-f83bbba11fac admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.528887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3e71-75e7-431e-a8b0-216a299d699b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.529515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3e71-75e7-431e-a8b0-216a299d699b service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.529797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3e71-75e7-431e-a8b0-216a299d699b service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.530074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3e71-75e7-431e-a8b0-216a299d699b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.538904 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3e71-75e7-431e-a8b0-216a299d699b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.540319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3e71-75e7-431e-a8b0-216a299d699b service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.549589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1283/2535] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:46.694216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9a4bf-3f7d-440f-9af0-82263ef8742e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.737564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:46.761991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9a4bf-3f7d-440f-9af0-82263ef8742e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:46.768042 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:46.768952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.769241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.769521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] PATH_INFO: `/v3/users/f78eb0eb9f8b4c4fb59000fece6be820` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.770722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78eb0eb9f8b4c4fb59000fece6be820)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:46.772859 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:46.820857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78eb0eb9f8b4c4fb59000fece6be820'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:46.821542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78eb0eb9f8b4c4fb59000fece6be820'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:46.833598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78eb0eb9f8b4c4fb59000fece6be820'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:46.840966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78eb0eb9f8b4c4fb59000fece6be820'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:46.842907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78eb0eb9f8b4c4fb59000fece6be820'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:46.858316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1253/2536] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:46 2022] DELETE /identity/v3/users/f78eb0eb9f8b4c4fb59000fece6be820 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:46.860001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:46.860351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:46.860773 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:46.878623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:46.879883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:46.937881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1284/2537] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:46.948076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:46.949511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:47.005620 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4507188-9127-4f0e-b97b-dae4f1b62f3e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:47.009884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:47.010533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:47.010845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:47.011128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:47.020329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:47.021855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:47.031484 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1254/2538] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:47.309887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:47.311326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:47.329141 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0d607-ea90-4bc6-bb3f-7cdc77bb10ac None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:47.334393 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:47.335353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:47.335703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:47.336052 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] PATH_INFO: `/v3/projects/ccc6fb03419d4d93bd22905df7654009` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:47.337340 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc6fb03419d4d93bd22905df7654009)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:47.339567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:47.351960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:47.386517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc6fb03419d4d93bd22905df7654009', 'request_id': 'req-1699727f-c246-458d-b1a7-83443c268269'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.391883 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc6fb03419d4d93bd22905df7654009', 'request_id': 'req-1699727f-c246-458d-b1a7-83443c268269'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.398429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc6fb03419d4d93bd22905df7654009', 'request_id': 'req-1699727f-c246-458d-b1a7-83443c268269'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.409925 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] The token cache is being invalidate because project ccc6fb03419d4d93bd22905df7654009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:47.410213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.411700 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.414037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1285/2539] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:47 2022] DELETE /identity/v3/projects/ccc6fb03419d4d93bd22905df7654009 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:47.418178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:47.428461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2efc5-723f-490d-aa6e-bd05feea79ed service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:47.484198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:47.485112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:47.485407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:47.485691 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] PATH_INFO: `/v3/users/f49973fe5d7242c6bbe95379e9a20d92` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:47.486911 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49973fe5d7242c6bbe95379e9a20d92)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:47.488884 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:47.491288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:47.537798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49973fe5d7242c6bbe95379e9a20d92'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.538472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49973fe5d7242c6bbe95379e9a20d92'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.550883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49973fe5d7242c6bbe95379e9a20d92'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.558145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49973fe5d7242c6bbe95379e9a20d92'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.558753 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-999ad423-5869-4b69-abdb-4ed0cc3be4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49973fe5d7242c6bbe95379e9a20d92'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.571214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1255/2540] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:47 2022] DELETE /identity/v3/users/f49973fe5d7242c6bbe95379e9a20d92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:47.839800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:47.841293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:47.857295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699727f-c246-458d-b1a7-83443c268269 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:47.924119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:47.925082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:47.925400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:47.925764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] PATH_INFO: `/v3/projects/2fc99e5607a54cac8b232ae46301983d` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:47.927160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc99e5607a54cac8b232ae46301983d)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:47.929786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:47.981123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc99e5607a54cac8b232ae46301983d', 'request_id': 'req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.987120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc99e5607a54cac8b232ae46301983d', 'request_id': 'req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:47.995441 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc99e5607a54cac8b232ae46301983d', 'request_id': 'req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:48.006627 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] The token cache is being invalidate because project 2fc99e5607a54cac8b232ae46301983d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:48.006905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:48.007531 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-41f48fd9-6317-4835-bf3e-fbf86a9b12c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:48.009107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1286/2541] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:47 2022] DELETE /identity/v3/projects/2fc99e5607a54cac8b232ae46301983d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:48.014083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5c736-60cf-4fb3-a1a2-4747e06af2fe None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.014382 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5c736-60cf-4fb3-a1a2-4747e06af2fe None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.014661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5c736-60cf-4fb3-a1a2-4747e06af2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.031819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f2d5c736-60cf-4fb3-a1a2-4747e06af2fe None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:48.033086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f2d5c736-60cf-4fb3-a1a2-4747e06af2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:48.092250 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1256/2542] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:48.100381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f1d7-5a8b-4bac-8592-03bca132f704 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.100706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f1d7-5a8b-4bac-8592-03bca132f704 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.100992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f1d7-5a8b-4bac-8592-03bca132f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.128304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-d225f1d7-5a8b-4bac-8592-03bca132f704 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:48.129564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d225f1d7-5a8b-4bac-8592-03bca132f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:48.137526 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1287/2543] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:48.141948 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5c736-60cf-4fb3-a1a2-4747e06af2fe None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.151660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5c736-60cf-4fb3-a1a2-4747e06af2fe None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.156483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.157168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.157450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.157723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.158444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:48.158750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.160345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.172958 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1257/2544] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:48.177431 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f1d7-5a8b-4bac-8592-03bca132f704 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.187696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f1d7-5a8b-4bac-8592-03bca132f704 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.197725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.198635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.198899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.199636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.199900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.202143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.231187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1288/2545] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:48.235997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.246922 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e682f64-228e-4459-8930-9d99521285ca admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.303712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.304383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.304695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.304977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.305913 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.307845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.321238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:48.327444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1258/2546] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:48.331386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.337210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:48.344400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d6f7e-b515-4ec8-bc2b-2ba1e28ac42b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.350914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.351583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.351871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.352160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.352958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.354597 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.365161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1289/2547] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:48.369255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.378996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458abb9c-c385-485a-9d53-bd0a92d44afc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.383661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33140-da77-4568-89ab-95d79cdd42ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.384322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33140-da77-4568-89ab-95d79cdd42ee admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.384645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33140-da77-4568-89ab-95d79cdd42ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.384932 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33140-da77-4568-89ab-95d79cdd42ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.385660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33140-da77-4568-89ab-95d79cdd42ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.387261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33140-da77-4568-89ab-95d79cdd42ee admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.398674 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1259/2548] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:48.402802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.413447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1e5d-da83-4a02-9321-3f8f7c26eb68 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.418059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.418929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.419213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.419487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] PATH_INFO: `/v3/projects/4ff2ba9acf2e404eb5075a8048602ca6/users/2f3e3358dca04107ae08af2b7f8b6aac/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.433997 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff2ba9acf2e404eb5075a8048602ca6, user_id=2f3e3358dca04107ae08af2b7f8b6aac, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.436656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.449664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1290/2549] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:48 2022] PUT /identity/v3/projects/4ff2ba9acf2e404eb5075a8048602ca6/users/2f3e3358dca04107ae08af2b7f8b6aac/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:48.462227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004666b9-8c91-40b4-bd68-b63168836649 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.462794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004666b9-8c91-40b4-bd68-b63168836649 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.462794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004666b9-8c91-40b4-bd68-b63168836649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.490364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-004666b9-8c91-40b4-bd68-b63168836649 None None] MFA Rules not processed for user `2f3e3358dca04107ae08af2b7f8b6aac`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:48.491569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-004666b9-8c91-40b4-bd68-b63168836649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:48.555696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1260/2550] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:48.560158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.621500 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082e5e-b0cf-4704-80eb-d9c97d9aad97 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.626103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.626756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.627072 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.627355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.628051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.630007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.655504 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1291/2551] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:48.659583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004666b9-8c91-40b4-bd68-b63168836649 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.671325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004666b9-8c91-40b4-bd68-b63168836649 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.728613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.729291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.729572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.729846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.730561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.732470 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.752319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1261/2552] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:48.756237 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.766487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900d39c-9233-4b18-b4f0-17328af8a269 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.771144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.771799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.772089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.772372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.773136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.774736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.789636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1292/2553] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:48.793655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.804529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2f0bc-1e60-49fc-9b84-981d86aa26d9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.809522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.810454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.810738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.811014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] PATH_INFO: `/v3/projects/343597a011924aef8b2c898c8d351903/users/decd830618dc4e5f94f3262d6005b407/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.825727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343597a011924aef8b2c898c8d351903, user_id=decd830618dc4e5f94f3262d6005b407, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.828361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.841582 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1262/2554] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:48 2022] PUT /identity/v3/projects/343597a011924aef8b2c898c8d351903/users/decd830618dc4e5f94f3262d6005b407/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:48.845436 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.856515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf12e7-2729-4ef6-a416-bcf50b270786 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.912828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01000b-0cc3-42ee-8884-77a94f5896bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.913489 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01000b-0cc3-42ee-8884-77a94f5896bf admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.913772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01000b-0cc3-42ee-8884-77a94f5896bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.914050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01000b-0cc3-42ee-8884-77a94f5896bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.914764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01000b-0cc3-42ee-8884-77a94f5896bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.916353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01000b-0cc3-42ee-8884-77a94f5896bf admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.925867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1293/2555] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:48.930940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:48.940842 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd382c1-a649-40ea-bd58-cc84090f5f90 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:48.945378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:48.946257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.946533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.946804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] PATH_INFO: `/v3/projects/343597a011924aef8b2c898c8d351903/users/decd830618dc4e5f94f3262d6005b407/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.948871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=343597a011924aef8b2c898c8d351903, user_id=decd830618dc4e5f94f3262d6005b407, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:48.951486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:48.961921 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1263/2556] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:48 2022] PUT /identity/v3/projects/343597a011924aef8b2c898c8d351903/users/decd830618dc4e5f94f3262d6005b407/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:48.971568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:48.971861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:48.972139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:48.998353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] MFA Rules not processed for user `decd830618dc4e5f94f3262d6005b407`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:48.999549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.020871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:49.023235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.026001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:49.056003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:49.071593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1294/2557] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:49.082159 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:49.083517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.090171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac57e-fe86-436d-8901-2eb1d958b2da admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:49.094904 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:49.095840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.096123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.096398 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] PATH_INFO: `/v3/users/484b694919df45bfa9b4287c9af0fae4` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.097639 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484b694919df45bfa9b4287c9af0fae4)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:49.100140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:49.143091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26af3d-9abc-44af-91f6-4b4e0a9a82b1 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:49.147586 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982233c-ec57-430a-9c5a-0f3f73e6fd73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:49.148339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982233c-ec57-430a-9c5a-0f3f73e6fd73 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.148764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982233c-ec57-430a-9c5a-0f3f73e6fd73 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.149151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982233c-ec57-430a-9c5a-0f3f73e6fd73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.150947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484b694919df45bfa9b4287c9af0fae4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.151612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484b694919df45bfa9b4287c9af0fae4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.158547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982233c-ec57-430a-9c5a-0f3f73e6fd73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:49.160038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982233c-ec57-430a-9c5a-0f3f73e6fd73 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:49.164848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484b694919df45bfa9b4287c9af0fae4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.169954 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1295/2558] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:02:49.172367 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484b694919df45bfa9b4287c9af0fae4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.173117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484b694919df45bfa9b4287c9af0fae4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.186853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1264/2559] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:49 2022] DELETE /identity/v3/users/484b694919df45bfa9b4287c9af0fae4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:49.192040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.192395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.192707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.212563 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:49.213788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.277297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1296/2560] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:49.285207 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:49.286658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.348983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde95be-93b0-4981-bf9a-89834df6a193 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:49.352955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3d30c-bd32-4641-abbd-4b3f53976fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:49.353955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3d30c-bd32-4641-abbd-4b3f53976fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.354262 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3d30c-bd32-4641-abbd-4b3f53976fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.354543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3d30c-bd32-4641-abbd-4b3f53976fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.367401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3d30c-bd32-4641-abbd-4b3f53976fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:49.368872 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3d30c-bd32-4641-abbd-4b3f53976fb2 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:49.378370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1265/2561] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:49.680915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:49.684459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.710252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be771-c45c-4047-a12c-64a6615898a2 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:49.717078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:49.717960 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.718288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.718575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] PATH_INFO: `/v3/projects/289a1185e9aa410c8c311056e63feb99` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.719849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=289a1185e9aa410c8c311056e63feb99)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:49.721803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:49.781268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289a1185e9aa410c8c311056e63feb99', 'request_id': 'req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.787648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289a1185e9aa410c8c311056e63feb99', 'request_id': 'req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.790856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:49.797121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289a1185e9aa410c8c311056e63feb99', 'request_id': 'req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.810528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] The token cache is being invalidate because project 289a1185e9aa410c8c311056e63feb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:49.810829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.811625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e4559d-ca24-4ebd-adb4-dfd1be52e37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:49.813449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1297/2562] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:49 2022] DELETE /identity/v3/projects/289a1185e9aa410c8c311056e63feb99 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:49.820131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffbf9a-518d-4795-a751-de355023479b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.820640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffbf9a-518d-4795-a751-de355023479b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.820640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffbf9a-518d-4795-a751-de355023479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.839423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-89ffbf9a-518d-4795-a751-de355023479b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:49.840663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-89ffbf9a-518d-4795-a751-de355023479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.890449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:49.905755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1266/2563] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:49.914858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55293-fc1e-47c3-94a2-66b32a10828a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.915154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55293-fc1e-47c3-94a2-66b32a10828a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.915674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55293-fc1e-47c3-94a2-66b32a10828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.937940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ecb55293-fc1e-47c3-94a2-66b32a10828a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:49.939160 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ecb55293-fc1e-47c3-94a2-66b32a10828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:49.947683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1298/2564] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:49.951928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffbf9a-518d-4795-a751-de355023479b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:49.962255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffbf9a-518d-4795-a751-de355023479b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:49.967300 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:49.967974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:49.968263 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:49.968549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:49.969322 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:49.969637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:49.971456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:49.988290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1267/2565] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:49.989514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb55293-fc1e-47c3-94a2-66b32a10828a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:49.999893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb55293-fc1e-47c3-94a2-66b32a10828a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.004675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.005407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.005689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.006012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.006732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.008671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.040850 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1299/2566] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:49 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:50.042172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.056175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33d53-732a-4b03-8002-68564368fc2b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.125100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.126102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.126555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.126852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.128791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.131246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.154895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1268/2567] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:50 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:50.156000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.166613 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346dd47-00ea-4bd5-8acc-5ed0debb8469 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.171628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.172329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.172647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.172933 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.173669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.177209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.188615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1300/2568] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:02:50.194172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.207796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb657a-e8ea-4a51-973c-65df0bc9f150 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.214191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868ead-a22f-4b4f-b02a-b36b912faa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.214886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868ead-a22f-4b4f-b02a-b36b912faa96 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.215190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868ead-a22f-4b4f-b02a-b36b912faa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.215461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868ead-a22f-4b4f-b02a-b36b912faa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.216197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94868ead-a22f-4b4f-b02a-b36b912faa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.218378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94868ead-a22f-4b4f-b02a-b36b912faa96 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.229099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1269/2569] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:50.233381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.246452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d78be-0bbb-4857-8f7c-c2ee84eaa32e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.251542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.252511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.252842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.253124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] PATH_INFO: `/v3/projects/0773c07037c4432799acd4a35855183f/users/9b4419a599d34cb6ab0dbf374de6371c/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.271174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0773c07037c4432799acd4a35855183f, user_id=9b4419a599d34cb6ab0dbf374de6371c, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.272517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.286999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1301/2570] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:50 2022] PUT /identity/v3/projects/0773c07037c4432799acd4a35855183f/users/9b4419a599d34cb6ab0dbf374de6371c/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:50.298318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c2b5-a7f5-4212-9a14-e53ee2763e42 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.298611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c2b5-a7f5-4212-9a14-e53ee2763e42 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.298900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57c2b5-a7f5-4212-9a14-e53ee2763e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.328733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-2d57c2b5-a7f5-4212-9a14-e53ee2763e42 None None] MFA Rules not processed for user `9b4419a599d34cb6ab0dbf374de6371c`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:50.328733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2d57c2b5-a7f5-4212-9a14-e53ee2763e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:50.399160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1270/2571] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:50.403706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.470056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d0f30-a6ee-44ed-b45c-d46cf1dafd55 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.474649 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.475352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.475639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.475915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.476616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.478509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.509728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1302/2572] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:50 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:50.511017 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c2b5-a7f5-4212-9a14-e53ee2763e42 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.523552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57c2b5-a7f5-4212-9a14-e53ee2763e42 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.545785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.547587 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:50.570037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:50.583869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.584543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.584856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.585136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.585874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.587803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.610878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1271/2573] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:50 2022] POST /identity/v3/users => generated 306 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:50.611852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.616038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc9f6-8f4c-4e96-82d7-ad3dae8e17bd admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.620752 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.621625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.621746 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d229c7-5854-494c-8f42-4ae7b9d2e80e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.621906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.622176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] PATH_INFO: `/v3/users/2f3e3358dca04107ae08af2b7f8b6aac` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.623944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3e3358dca04107ae08af2b7f8b6aac)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.625882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.626362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.627007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.627301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.627581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.628298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.629899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.639161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:50.640643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1272/2574] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:02:50.645132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.655345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a33fc-58a7-406b-ab50-99d93c9af4f4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.661324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.662176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.662466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.662892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] PATH_INFO: `/v3/projects/3f89fc75a5d64e61a272a0ac43e069ff/users/f094f06afb6845a59bc55e4f14e46f96/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.674761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3e3358dca04107ae08af2b7f8b6aac'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:50.679940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f89fc75a5d64e61a272a0ac43e069ff, user_id=f094f06afb6845a59bc55e4f14e46f96, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.682669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3e3358dca04107ae08af2b7f8b6aac'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:50.682818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.696754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3e3358dca04107ae08af2b7f8b6aac'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:50.697486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3e3358dca04107ae08af2b7f8b6aac'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:50.698204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1273/2575] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:50 2022] PUT /identity/v3/projects/3f89fc75a5d64e61a272a0ac43e069ff/users/f094f06afb6845a59bc55e4f14e46f96/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:50.698402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-507c4e81-2c83-4e79-888d-fc5f7bc84df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3e3358dca04107ae08af2b7f8b6aac'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:50.702240 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.704167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:50.711376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1303/2576] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:50 2022] DELETE /identity/v3/users/2f3e3358dca04107ae08af2b7f8b6aac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:50.716117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.716663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.716946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.733499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:50.734712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:50.771511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1fb65-1abe-4fea-86ae-977790551130 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.794425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1304/2577] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:50.805451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.806877 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:50.830727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.831406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.831695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.831995 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.832758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.834391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.844993 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1274/2578] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:02:50.849082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:50.859370 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1476a5-8f16-45a1-8603-a3f38c0a1b17 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.864021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e42cd7-78c8-46fa-b429-740ba949f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.864926 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42cd7-78c8-46fa-b429-740ba949f590 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.865782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42cd7-78c8-46fa-b429-740ba949f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.866061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42cd7-78c8-46fa-b429-740ba949f590 admin admin] PATH_INFO: `/v3/projects/3f89fc75a5d64e61a272a0ac43e069ff/users/f094f06afb6845a59bc55e4f14e46f96/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.866854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632bffb-121d-40f0-8b25-f6f8f16260c9 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:50.871750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e42cd7-78c8-46fa-b429-740ba949f590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f89fc75a5d64e61a272a0ac43e069ff, user_id=f094f06afb6845a59bc55e4f14e46f96, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.871750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e42cd7-78c8-46fa-b429-740ba949f590 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.873712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:50.873712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.873712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.873712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.882946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:50.883576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1275/2579] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:50 2022] PUT /identity/v3/projects/3f89fc75a5d64e61a272a0ac43e069ff/users/f094f06afb6845a59bc55e4f14e46f96/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:50.884381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:50.893832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:50.894129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:50.894444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:50.894885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1305/2580] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:02:50.924603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] MFA Rules not processed for user `f094f06afb6845a59bc55e4f14e46f96`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:50.925919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:50.947563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:51.004499 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1276/2581] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:51.015965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:51.017785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:51.058857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:51.084888 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552397e-de0f-4a72-86c0-01131d8d0d26 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:51.139330 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:51.139989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:51.140416 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:51.140736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:51.153068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:51.154537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:51.166832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1306/2582] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:51.186733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:51.188716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:51.265893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:51.276209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb2e2d-1bdd-4261-861d-d9797bd7c18e service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:51.279976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:51.280713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:51.280992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:51.281277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:51.283193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:51.289310 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49ac2-189a-4fda-87d6-0f7998d10fd8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:51.295645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:51.296138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:51.296490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:51.296855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] PATH_INFO: `/v3/projects/4ff2ba9acf2e404eb5075a8048602ca6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:51.298094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff2ba9acf2e404eb5075a8048602ca6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:51.300054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:51.375634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff2ba9acf2e404eb5075a8048602ca6', 'request_id': 'req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.378915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:51.380375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:51.385090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff2ba9acf2e404eb5075a8048602ca6', 'request_id': 'req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.390772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1307/2583] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:02:51.394306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff2ba9acf2e404eb5075a8048602ca6', 'request_id': 'req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.411628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] The token cache is being invalidate because project 4ff2ba9acf2e404eb5075a8048602ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:51.411994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.412801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.414652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1277/2584] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:51 2022] DELETE /identity/v3/projects/4ff2ba9acf2e404eb5075a8048602ca6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:51.419099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:51.430935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81524722-5257-4153-a97a-f0a19627f03d service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:51.512120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:51.513331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:51.513741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:51.514137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] PATH_INFO: `/v3/users/decd830618dc4e5f94f3262d6005b407` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:51.516226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=decd830618dc4e5f94f3262d6005b407)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:51.518705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:51.570938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:51.590186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decd830618dc4e5f94f3262d6005b407'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.598519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decd830618dc4e5f94f3262d6005b407'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.613641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decd830618dc4e5f94f3262d6005b407'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.614536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decd830618dc4e5f94f3262d6005b407'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.615993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-4db861e0-57d2-4bd8-9953-e8105a978dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decd830618dc4e5f94f3262d6005b407'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:51.636670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1308/2585] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:51 2022] DELETE /identity/v3/users/decd830618dc4e5f94f3262d6005b407 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:51.923721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:51.925143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:51.941206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0f9ec-3278-4483-aad5-e7ac666b9b2a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:51.987008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:52.002352 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.003233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.003524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.003809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] PATH_INFO: `/v3/projects/343597a011924aef8b2c898c8d351903` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.005081 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=343597a011924aef8b2c898c8d351903)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.007039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.053481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343597a011924aef8b2c898c8d351903', 'request_id': 'req-35992810-9d16-4fa0-8599-c9ada7ab1cd5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:52.061306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343597a011924aef8b2c898c8d351903', 'request_id': 'req-35992810-9d16-4fa0-8599-c9ada7ab1cd5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:52.067612 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343597a011924aef8b2c898c8d351903', 'request_id': 'req-35992810-9d16-4fa0-8599-c9ada7ab1cd5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:52.078573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] The token cache is being invalidate because project 343597a011924aef8b2c898c8d351903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:52.078887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:52.079518 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-35992810-9d16-4fa0-8599-c9ada7ab1cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:52.081106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1278/2586] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:51 2022] DELETE /identity/v3/projects/343597a011924aef8b2c898c8d351903 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:52.086444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb83a-9a03-41cb-91cd-eb887d3835fd None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.086932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb83a-9a03-41cb-91cd-eb887d3835fd None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.087042 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb83a-9a03-41cb-91cd-eb887d3835fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.106614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-dbbeb83a-9a03-41cb-91cd-eb887d3835fd None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:52.108105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-dbbeb83a-9a03-41cb-91cd-eb887d3835fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:52.170523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1309/2587] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:52.179487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fe3f-f614-4b92-87be-c42fc4f1b05a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.179726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fe3f-f614-4b92-87be-c42fc4f1b05a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.180002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fe3f-f614-4b92-87be-c42fc4f1b05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.198850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-b3b5fe3f-f614-4b92-87be-c42fc4f1b05a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:52.200096 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-b3b5fe3f-f614-4b92-87be-c42fc4f1b05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:52.208115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1279/2588] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:52.213115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb83a-9a03-41cb-91cd-eb887d3835fd None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.222981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb83a-9a03-41cb-91cd-eb887d3835fd None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.228216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.228950 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.229236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.229542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.230297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:52.230605 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.232203 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.244778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1310/2589] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:52.249040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5fe3f-f614-4b92-87be-c42fc4f1b05a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.258412 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5fe3f-f614-4b92-87be-c42fc4f1b05a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.263226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.263886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.264173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.264454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.265196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.267152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.294163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1280/2590] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:52 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:52.298301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.308712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6ab8-bf03-4634-b9e4-38547f1d120e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.366181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.366857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.367145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.367426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.368121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.370099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.390598 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1311/2591] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:52 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:52.394703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.405975 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f221ee-a6fd-4797-874e-23521bbde72a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.410683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.411359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.411651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.411974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.412752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.414359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.424902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1281/2592] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:52.428979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.439981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13e08-d4b6-4c2d-b0d2-75b0a313ddd3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.445123 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a53b0-c3a5-4f81-9ec1-dcc59e3a3dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.445793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a53b0-c3a5-4f81-9ec1-dcc59e3a3dda admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.446082 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a53b0-c3a5-4f81-9ec1-dcc59e3a3dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.446363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a53b0-c3a5-4f81-9ec1-dcc59e3a3dda admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.447091 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a53b0-c3a5-4f81-9ec1-dcc59e3a3dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.448730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a53b0-c3a5-4f81-9ec1-dcc59e3a3dda admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.459719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1312/2593] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:52.463850 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.475083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90103a0e-a9fe-4bec-8879-5d3539ec9ebc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.481149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.482165 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.482595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.483009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] PATH_INFO: `/v3/projects/5745aabd4c804cb59640710036e9be99/users/1e08426448d5482e8979b078a73644b6/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.498692 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5745aabd4c804cb59640710036e9be99, user_id=1e08426448d5482e8979b078a73644b6, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.501381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.514420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1282/2594] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:52 2022] PUT /identity/v3/projects/5745aabd4c804cb59640710036e9be99/users/1e08426448d5482e8979b078a73644b6/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:52.525374 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb549-2d87-47d7-9cae-803487fbc62e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.525674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb549-2d87-47d7-9cae-803487fbc62e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.525963 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb549-2d87-47d7-9cae-803487fbc62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.552126 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-8a8eb549-2d87-47d7-9cae-803487fbc62e None None] MFA Rules not processed for user `1e08426448d5482e8979b078a73644b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:52.553384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8a8eb549-2d87-47d7-9cae-803487fbc62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:52.557604 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:52.619326 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1313/2595] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:52.623847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.686095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af3c1e-75f4-4408-b9ae-ceeff1168bc2 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.690804 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.691399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.691683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.691964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.692690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.695118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.715579 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:52.723488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1283/2596] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:52 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:52.727268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb549-2d87-47d7-9cae-803487fbc62e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.738275 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb549-2d87-47d7-9cae-803487fbc62e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.798218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.798916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.799209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.799493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.800202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.802191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.827105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1314/2597] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:52 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:02:52.828535 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.839176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2e36-01d5-461a-b1e6-735af4f473bf admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.843856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.844524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.844845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.845128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.845857 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.847446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.860626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1284/2598] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:52.865273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.875336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ae58-e5f4-41da-bc9d-41b07201abae admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:52.881008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:52.881893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:52.882176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:52.882454 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] PATH_INFO: `/v3/projects/af6defd9f0d44164a485c82763eabe3c/users/f4f259281c56434d8ad13c4dbc76d7a4/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:52.905584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6defd9f0d44164a485c82763eabe3c, user_id=f4f259281c56434d8ad13c4dbc76d7a4, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:52.908459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:52.922667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1315/2599] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:52 2022] PUT /identity/v3/projects/af6defd9f0d44164a485c82763eabe3c/users/f4f259281c56434d8ad13c4dbc76d7a4/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:52.926785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:52.937556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6dbbc-2dfa-48de-bda3-41405897da18 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:53.000713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eaccb-0282-4329-884e-e88114a47739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:53.001397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eaccb-0282-4329-884e-e88114a47739 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.001683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eaccb-0282-4329-884e-e88114a47739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.001964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eaccb-0282-4329-884e-e88114a47739 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.002693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eaccb-0282-4329-884e-e88114a47739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:53.004329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eaccb-0282-4329-884e-e88114a47739 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:53.019981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1285/2600] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:02:53.021012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:53.032081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba4d54-1ab6-485a-b9dc-9b52ad6fe3ff admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:53.037633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:53.038519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.038802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.039080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] PATH_INFO: `/v3/projects/af6defd9f0d44164a485c82763eabe3c/users/f4f259281c56434d8ad13c4dbc76d7a4/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.041186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6defd9f0d44164a485c82763eabe3c, user_id=f4f259281c56434d8ad13c4dbc76d7a4, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:53.043864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:53.061409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1316/2601] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:53 2022] PUT /identity/v3/projects/af6defd9f0d44164a485c82763eabe3c/users/f4f259281c56434d8ad13c4dbc76d7a4/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:53.072349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8037a36-0e34-4d72-9eeb-ae3e770510ed None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.072662 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8037a36-0e34-4d72-9eeb-ae3e770510ed None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.072947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8037a36-0e34-4d72-9eeb-ae3e770510ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.100024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e8037a36-0e34-4d72-9eeb-ae3e770510ed None None] MFA Rules not processed for user `f4f259281c56434d8ad13c4dbc76d7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:53.101375 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e8037a36-0e34-4d72-9eeb-ae3e770510ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:53.182306 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1286/2602] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:53.195378 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:53.197199 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:53.253770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d604e7f-e818-4928-98f8-aa1226adfd68 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:53.258057 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:53.258685 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.258981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.259287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.268288 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:53.269768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:53.275335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:53.280499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1317/2603] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:53.591487 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8037a36-0e34-4d72-9eeb-ae3e770510ed None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:53.600711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8037a36-0e34-4d72-9eeb-ae3e770510ed None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:53.605433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f259281c56434d8ad13c4dbc76d7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af6defd9f0d44164a485c82763eabe3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:53.606089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.606379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.606663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.607409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:53.607745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:53.609383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:53.621568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1287/2604] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:53.625520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:53.635227 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048aa5-e661-438f-a1ca-4ee0322fbf90 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:53.639823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f259281c56434d8ad13c4dbc76d7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af6defd9f0d44164a485c82763eabe3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:53.640465 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.640788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.641074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.641761 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:53.643668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:53.668833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1318/2605] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:53 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:53.672851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:53.683575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcbcc6-aad8-41d5-a5c7-0ef41493a11a tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:53.736828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:53.744660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f259281c56434d8ad13c4dbc76d7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af6defd9f0d44164a485c82763eabe3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:53.745328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.745615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.745900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.746667 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:53.746978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:53.748608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:53.761722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1288/2606] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:53.801419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:53.812256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91defb5-aa13-4d5f-8e38-2ed2e715db6c tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:53.816864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f259281c56434d8ad13c4dbc76d7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af6defd9f0d44164a485c82763eabe3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:53.817741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:53.818689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:53.818998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] PATH_INFO: `/v3/projects/0a67bf9b05d24622afc068a06b32d744` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:53.820188 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a67bf9b05d24622afc068a06b32d744)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:53.822117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:53.873184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a67bf9b05d24622afc068a06b32d744', 'request_id': 'req-e5219128-b7bb-41da-847d-7429405f50fa'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:53.879187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a67bf9b05d24622afc068a06b32d744', 'request_id': 'req-e5219128-b7bb-41da-847d-7429405f50fa'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:53.887260 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a67bf9b05d24622afc068a06b32d744', 'request_id': 'req-e5219128-b7bb-41da-847d-7429405f50fa'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:53.898705 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] The token cache is being invalidate because project 0a67bf9b05d24622afc068a06b32d744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:53.898996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:53.899772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-e5219128-b7bb-41da-847d-7429405f50fa tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:53.901348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1319/2607] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:53 2022] DELETE /identity/v3/projects/0a67bf9b05d24622afc068a06b32d744 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:54.095581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:54.097542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:54.166214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1563-3141-43bc-9e54-22ec54518f92 tempest-VolumeQuotaClassesTest-2144867147 tempest-VolumeQuotaClassesTest-2144867147-project-admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:54.237828 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:54.238718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:54.239021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:54.239349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] PATH_INFO: `/v3/users/1e08426448d5482e8979b078a73644b6` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:54.240565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e08426448d5482e8979b078a73644b6)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:54.243800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:54.298787 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e08426448d5482e8979b078a73644b6'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.299493 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e08426448d5482e8979b078a73644b6'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.314761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e08426448d5482e8979b078a73644b6'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.323782 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e08426448d5482e8979b078a73644b6'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.324548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e08426448d5482e8979b078a73644b6'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.338399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1289/2608] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:54 2022] DELETE /identity/v3/users/1e08426448d5482e8979b078a73644b6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:54.342695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:54.343148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:54.343268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:54.360424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:54.361654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:54.419254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1320/2609] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:54.429784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:54.431442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:54.450182 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:54.490347 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df673d7f-de63-4d0c-a16a-7f9d42c660ba admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:54.494159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:54.494802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:54.495139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:54.495462 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:54.504759 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:54.506847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:54.516323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1290/2610] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:54.788423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:54.789846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:54.804003 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e07c-e564-44ed-81c0-17e0ac75b831 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:54.809832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:54.811250 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:54.811702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:54.811991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] PATH_INFO: `/v3/projects/5745aabd4c804cb59640710036e9be99` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:54.813248 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5745aabd4c804cb59640710036e9be99)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:54.815179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:54.831826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:54.833316 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:54.845450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612cad-f1b1-483d-a7a4-699ab0a26e38 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:54.849547 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:54.850200 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:54.850486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:54.850770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:54.852522 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:54.865745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5745aabd4c804cb59640710036e9be99', 'request_id': 'req-a03ba605-4c6f-4f55-aed6-149f22fbef25'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.871310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:54.873561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5745aabd4c804cb59640710036e9be99', 'request_id': 'req-a03ba605-4c6f-4f55-aed6-149f22fbef25'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.883421 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5745aabd4c804cb59640710036e9be99', 'request_id': 'req-a03ba605-4c6f-4f55-aed6-149f22fbef25'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.895588 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] The token cache is being invalidate because project 5745aabd4c804cb59640710036e9be99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:54.895886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.897099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:54.899138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1321/2611] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:54 2022] DELETE /identity/v3/projects/5745aabd4c804cb59640710036e9be99 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:54.903179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:54.904525 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:54.917001 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:54.918485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:54.928282 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1291/2612] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:02:54.969388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba605-4c6f-4f55-aed6-149f22fbef25 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:54.974958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:54.975842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:54.976131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:54.976413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] PATH_INFO: `/v3/users/f4f259281c56434d8ad13c4dbc76d7a4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:54.977671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f259281c56434d8ad13c4dbc76d7a4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:54.979607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:55.027012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f259281c56434d8ad13c4dbc76d7a4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.034205 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f259281c56434d8ad13c4dbc76d7a4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.047892 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f259281c56434d8ad13c4dbc76d7a4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.048967 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f259281c56434d8ad13c4dbc76d7a4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.049305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f259281c56434d8ad13c4dbc76d7a4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.064166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1322/2613] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:54 2022] DELETE /identity/v3/users/f4f259281c56434d8ad13c4dbc76d7a4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:55.547417 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:55.549135 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:55.565814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c0d32-5d1b-4bfd-8f18-91361e785773 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:55.638046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:55.639888 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:55.640697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:55.640849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:55.641301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:55.641592 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] PATH_INFO: `/v3/users/9b4419a599d34cb6ab0dbf374de6371c` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:55.643115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4419a599d34cb6ab0dbf374de6371c)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:55.645602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:55.661131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d77d8-7c53-4254-812d-ce39933a0ea0 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:55.668065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:55.669986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:55.670370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:55.670726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] PATH_INFO: `/v3/projects/af6defd9f0d44164a485c82763eabe3c` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:55.672040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6defd9f0d44164a485c82763eabe3c)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:55.674053 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:55.706332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4419a599d34cb6ab0dbf374de6371c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.707214 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4419a599d34cb6ab0dbf374de6371c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.717864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:55.724986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4419a599d34cb6ab0dbf374de6371c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.733778 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6defd9f0d44164a485c82763eabe3c', 'request_id': 'req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.736294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4419a599d34cb6ab0dbf374de6371c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.737061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a2d810af-f61c-44e6-9af4-d4cf7b03dc22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4419a599d34cb6ab0dbf374de6371c'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.741973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6defd9f0d44164a485c82763eabe3c', 'request_id': 'req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.743695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:55.752672 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6defd9f0d44164a485c82763eabe3c', 'request_id': 'req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.754143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1292/2614] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:55 2022] DELETE /identity/v3/users/9b4419a599d34cb6ab0dbf374de6371c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:55.758861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:55.759168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:55.759455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:55.766737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] The token cache is being invalidate because project af6defd9f0d44164a485c82763eabe3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:55.767033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.767706 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-368fc1e3-91ca-42f4-8ff8-63b87d06b4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:55.769304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1323/2615] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:55 2022] DELETE /identity/v3/projects/af6defd9f0d44164a485c82763eabe3c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:55.774763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6ccb-47ff-41f9-8d99-5a440813b158 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:55.775063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6ccb-47ff-41f9-8d99-5a440813b158 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:55.775356 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6ccb-47ff-41f9-8d99-5a440813b158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:55.780337 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:55.781658 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:55.795009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-713b6ccb-47ff-41f9-8d99-5a440813b158 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:55.796224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-713b6ccb-47ff-41f9-8d99-5a440813b158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:55.854303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1293/2616] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:55.868909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:55.870672 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:55.877111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1324/2617] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:55.879024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585144a-70f4-41a7-a3eb-2b02bc1b567d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:55.879324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585144a-70f4-41a7-a3eb-2b02bc1b567d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:55.879748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585144a-70f4-41a7-a3eb-2b02bc1b567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:55.910146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c585144a-70f4-41a7-a3eb-2b02bc1b567d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:55.911390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c585144a-70f4-41a7-a3eb-2b02bc1b567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:55.924994 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1325/2618] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:55.925935 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585144a-70f4-41a7-a3eb-2b02bc1b567d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:55.946736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585144a-70f4-41a7-a3eb-2b02bc1b567d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:55.952878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:55.964949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:55.965270 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:55.965539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:55.966304 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:55.966621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:55.973364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:55.979588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846369-7572-4b22-9408-a1576cf672cf None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:55.985014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:55.985803 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:55.986074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:55.986363 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:55.992736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1326/2619] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:55.997018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:55.998830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.000562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.012030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43a2b-b653-4b2f-a975-710e34c72470 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.013447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1294/2620] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:56.018107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.018944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.019242 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.019510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.020404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.022923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.067583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1327/2621] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:55 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:56.069076 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.080486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8007e0-abe8-418b-b4d9-88ee025478cb service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.173785 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.174625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.174919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.175591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.176569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.178677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.211279 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1295/2622] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:56 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:56.217834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.234905 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796e81-7153-40c7-b437-99bd709a4778 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.242842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.244026 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.244379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.244771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.245747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.248991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.274388 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.287757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1328/2623] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:56.295553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1a6fd-c60c-430b-b127-0c3d368daac1 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.301660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.302345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.302628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.303261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.304164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.306722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.312538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:56.327520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.331944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1296/2624] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:56.339940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7811c-d626-40a1-b042-011f474a7050 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.345064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f3c20-e6f5-4c74-81ac-8f1769b7362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.345640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3c20-e6f5-4c74-81ac-8f1769b7362f admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.345929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3c20-e6f5-4c74-81ac-8f1769b7362f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.346212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f3c20-e6f5-4c74-81ac-8f1769b7362f admin admin] PATH_INFO: `/v3/projects/1ac63dd2ce404a0787b1d3727b60d996/users/f3a07ca799b74c3ebf2cede673595504/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.362223 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f3c20-e6f5-4c74-81ac-8f1769b7362f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac63dd2ce404a0787b1d3727b60d996, user_id=f3a07ca799b74c3ebf2cede673595504, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.364971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f3c20-e6f5-4c74-81ac-8f1769b7362f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.387923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.388166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1329/2625] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:56 2022] PUT /identity/v3/projects/1ac63dd2ce404a0787b1d3727b60d996/users/f3a07ca799b74c3ebf2cede673595504/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:56.388284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:56.389818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.390110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.390435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.400260 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639b43-8bf5-40bb-ba02-ec51ffe2fcf8 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.425388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] MFA Rules not processed for user `f3a07ca799b74c3ebf2cede673595504`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:56.426748 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:56.472766 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.474004 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.474513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.475038 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] PATH_INFO: `/v3/projects/0773c07037c4432799acd4a35855183f` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.476340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0773c07037c4432799acd4a35855183f)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.478385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.504165 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:56.509105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1330/2626] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:56.522784 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.524403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:56.533774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0773c07037c4432799acd4a35855183f', 'request_id': 'req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.543565 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0773c07037c4432799acd4a35855183f', 'request_id': 'req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.554331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0773c07037c4432799acd4a35855183f', 'request_id': 'req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.569167 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] The token cache is being invalidate because project 0773c07037c4432799acd4a35855183f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:56.569496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.570129 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.571892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1297/2627] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:56 2022] DELETE /identity/v3/projects/0773c07037c4432799acd4a35855183f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:56.575414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.576792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:56.595936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4537e3-e925-4501-94bf-6cbd072c1048 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.659621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdea8bf-fc3b-491d-95e9-9587cea6dc10 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.666771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.668060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.668359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.668719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] PATH_INFO: `/v3/users/f094f06afb6845a59bc55e4f14e46f96` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.668914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.669562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.669846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.670125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.670291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f094f06afb6845a59bc55e4f14e46f96)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.672523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:56.672678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.716319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:56.738840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f094f06afb6845a59bc55e4f14e46f96'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.739521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f094f06afb6845a59bc55e4f14e46f96'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.740341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.741846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.752009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1331/2628] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:02:56.754060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f094f06afb6845a59bc55e4f14e46f96'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.765132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f094f06afb6845a59bc55e4f14e46f96'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.765972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-14a6eff9-dac8-4f61-bb4c-787f51d89b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f094f06afb6845a59bc55e4f14e46f96'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.773127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:56.777814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:56.781235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1298/2629] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:56 2022] DELETE /identity/v3/users/f094f06afb6845a59bc55e4f14e46f96 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:56.795324 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb945e-779d-46a5-8b00-05ffb1c66c77 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:56.864644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:56.866074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.866371 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.866637 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] PATH_INFO: `/v3/users/f3a07ca799b74c3ebf2cede673595504` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:56.867908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a07ca799b74c3ebf2cede673595504)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:56.869881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:56.883555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:56.935608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a07ca799b74c3ebf2cede673595504'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.949152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a07ca799b74c3ebf2cede673595504'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.965132 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a07ca799b74c3ebf2cede673595504'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.966218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a07ca799b74c3ebf2cede673595504'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.966864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a07ca799b74c3ebf2cede673595504'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:56.981349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1332/2630] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:56 2022] DELETE /identity/v3/users/f3a07ca799b74c3ebf2cede673595504 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:56.985862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:56.986159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:56.986443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.004201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:57.006044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.080175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1299/2631] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:57.090878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.092442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.104423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.106107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.118533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7768a7-9b09-4dc3-b9a1-a73e1729599b None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.125070 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.126083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.126376 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.127233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] PATH_INFO: `/v3/projects/3f89fc75a5d64e61a272a0ac43e069ff` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.128296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f89fc75a5d64e61a272a0ac43e069ff)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.130249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.165334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59da2-c70c-4982-a368-11fb71c99d07 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.169015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94ad54-5d30-4fc6-8a9c-52c62ca03a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.169657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94ad54-5d30-4fc6-8a9c-52c62ca03a85 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.169942 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94ad54-5d30-4fc6-8a9c-52c62ca03a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.170224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94ad54-5d30-4fc6-8a9c-52c62ca03a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.180134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94ad54-5d30-4fc6-8a9c-52c62ca03a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.180969 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f89fc75a5d64e61a272a0ac43e069ff', 'request_id': 'req-038c3e48-9e78-4ad9-9728-24949aab004e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.181856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94ad54-5d30-4fc6-8a9c-52c62ca03a85 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.192148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1333/2632] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:02:57.193120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f89fc75a5d64e61a272a0ac43e069ff', 'request_id': 'req-038c3e48-9e78-4ad9-9728-24949aab004e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.199876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f89fc75a5d64e61a272a0ac43e069ff', 'request_id': 'req-038c3e48-9e78-4ad9-9728-24949aab004e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.212206 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] The token cache is being invalidate because project 3f89fc75a5d64e61a272a0ac43e069ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:57.212504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.213223 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-038c3e48-9e78-4ad9-9728-24949aab004e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.216890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1300/2633] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:57 2022] DELETE /identity/v3/projects/3f89fc75a5d64e61a272a0ac43e069ff => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:57.221944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd71734-99c1-4553-9cf9-c1331f919fe7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.222239 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd71734-99c1-4553-9cf9-c1331f919fe7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.222524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd71734-99c1-4553-9cf9-c1331f919fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.241138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5cd71734-99c1-4553-9cf9-c1331f919fe7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:57.242508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5cd71734-99c1-4553-9cf9-c1331f919fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.344534 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1334/2634] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:57.350407 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e4819-ef4e-4243-bc71-1e99535a7b57 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.350858 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e4819-ef4e-4243-bc71-1e99535a7b57 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.350974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e4819-ef4e-4243-bc71-1e99535a7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.387083 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-089e4819-ef4e-4243-bc71-1e99535a7b57 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:57.388778 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-089e4819-ef4e-4243-bc71-1e99535a7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.397309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1301/2635] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:57.401703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd71734-99c1-4553-9cf9-c1331f919fe7 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.412376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd71734-99c1-4553-9cf9-c1331f919fe7 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.417217 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.417822 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.418140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.418446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.419184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:57.419495 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.421184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.436614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1335/2636] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:57.438448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e4819-ef4e-4243-bc71-1e99535a7b57 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.447942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e4819-ef4e-4243-bc71-1e99535a7b57 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.452693 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.453346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.453631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.453905 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.454588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.456501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.486863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1302/2637] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:57.488041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.498238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7a8ce-46f6-45ac-a479-2dd12fa83c91 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.516198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:57.560536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.562488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.567660 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:57.572224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.572941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.573382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.573667 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.574363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.576941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.599499 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1336/2638] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:57.603353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.613268 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd849ebb-4467-4d32-96d5-fbb4e5851d49 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.618366 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.619063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.619354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.619640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.620375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.622049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.634069 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1337/2639] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:02:57.638284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.639437 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6f10-27c7-4406-b18b-57b510e292f6 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.644682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.646671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.647207 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.647729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] PATH_INFO: `/v3/projects/1ac63dd2ce404a0787b1d3727b60d996` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.649125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac63dd2ce404a0787b1d3727b60d996)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.650674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c15af-84b6-4baa-970d-a8cf2ade05e9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.651816 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.655453 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.656121 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.656412 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.656743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.657476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.659102 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.670346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1338/2640] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:02:57.674361 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.684992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b3f6b-284f-47bb-ae2d-04db73eb308f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.689803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a8302-02e6-442c-8cf9-73f3f1a7d13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.690683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8302-02e6-442c-8cf9-73f3f1a7d13b admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.690969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8302-02e6-442c-8cf9-73f3f1a7d13b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.691252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8302-02e6-442c-8cf9-73f3f1a7d13b admin admin] PATH_INFO: `/v3/projects/3522a2e913564f749b7564f4e855731f/users/35c092f90aee4b19a6459f226e62fad8/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.701130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac63dd2ce404a0787b1d3727b60d996', 'request_id': 'req-8cba292d-0fa4-42e5-9220-5d917e5270f3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.706866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a8302-02e6-442c-8cf9-73f3f1a7d13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3522a2e913564f749b7564f4e855731f, user_id=35c092f90aee4b19a6459f226e62fad8, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.708326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac63dd2ce404a0787b1d3727b60d996', 'request_id': 'req-8cba292d-0fa4-42e5-9220-5d917e5270f3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.710252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a8302-02e6-442c-8cf9-73f3f1a7d13b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.714735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac63dd2ce404a0787b1d3727b60d996', 'request_id': 'req-8cba292d-0fa4-42e5-9220-5d917e5270f3'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.726174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] The token cache is being invalidate because project 1ac63dd2ce404a0787b1d3727b60d996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:57.726467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.727133 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8cba292d-0fa4-42e5-9220-5d917e5270f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:57.728652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1339/2641] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:57 2022] PUT /identity/v3/projects/3522a2e913564f749b7564f4e855731f/users/35c092f90aee4b19a6459f226e62fad8/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:57.728946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1303/2642] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:57 2022] DELETE /identity/v3/projects/1ac63dd2ce404a0787b1d3727b60d996 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:57.733503 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887da0-ca41-4eb3-8aab-df71a99e9e72 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.733804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887da0-ca41-4eb3-8aab-df71a99e9e72 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.734099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887da0-ca41-4eb3-8aab-df71a99e9e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.734733 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.735033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.735318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.751584 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-24887da0-ca41-4eb3-8aab-df71a99e9e72 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:57.752830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-24887da0-ca41-4eb3-8aab-df71a99e9e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.765232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] MFA Rules not processed for user `35c092f90aee4b19a6459f226e62fad8`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:57.766409 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.819624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1340/2643] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:57.828633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0e29-93cd-478f-9c3b-b5d7c176d06d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.829140 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0e29-93cd-478f-9c3b-b5d7c176d06d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.829422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0e29-93cd-478f-9c3b-b5d7c176d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.845272 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1304/2644] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:57.847801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-628f0e29-93cd-478f-9c3b-b5d7c176d06d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:57.849164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-628f0e29-93cd-478f-9c3b-b5d7c176d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.849609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.850889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:57.857086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1341/2645] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:57.861515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f0e29-93cd-478f-9c3b-b5d7c176d06d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.864244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cfe6d-4f36-4804-a819-3f40c0a41154 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.868945 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.869602 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.869880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.870160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.870287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f0e29-93cd-478f-9c3b-b5d7c176d06d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.870852 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.872779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.874793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.875429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:57.875710 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:57.875991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:57.876735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:57.877048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:57.878624 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:57.891770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1342/2646] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 15:02:57.899002 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.900056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:57.910800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ab16-c5eb-43e6-821c-083eb00bb8ee admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.913354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1305/2647] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:02:57.917107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:57.972853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:57.998074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:57.999566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501727-e98d-4234-ab54-eb505ec62a24 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:57.999852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.000469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.001589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.002941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.005080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.006134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.007951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.007951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.007951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.007951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.009699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.046762 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1306/2648] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:02:58.047802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.051158 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1343/2649] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:57 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:58.056553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.059764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6866e8-076b-4561-9f4f-114a10492aa1 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.138780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.139461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.139749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.140025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.140791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.142408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.145418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e9f0e-c6f8-4883-9f4e-56122a45632b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.150093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.150775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.151084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.151348 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.152047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.154152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.154652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1307/2650] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:58.158844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.169712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536198-6844-4817-9061-1fa0cc01da7d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.174912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.175802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.176080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.176361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] PATH_INFO: `/v3/projects/75d1be9c406e418c83a7b71d2506070d/users/d924398231da4b25ab60f436c2051791/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.187055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1344/2651] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:58 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:02:58.202265 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.204791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d1be9c406e418c83a7b71d2506070d, user_id=d924398231da4b25ab60f436c2051791, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.207626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.218449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea743e9-4afb-4f17-84a9-b25109bc1a70 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.224375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.225156 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.225521 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.225902 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.226643 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.228267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.229825 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1308/2652] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:58 2022] PUT /identity/v3/projects/75d1be9c406e418c83a7b71d2506070d/users/d924398231da4b25ab60f436c2051791/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:58.233883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.243547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1345/2653] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:58.244769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.258233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc874f6-ca6c-45ab-a6bc-4ab30d801fd3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.308973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6ef29-e509-435f-a8f6-bf690c3e6781 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.314434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.315364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.315936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.316423 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.317567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.319980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.322703 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:58.327024 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.327703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.327991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.328272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.329765 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.331407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.334150 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1309/2654] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:58.338664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.342656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1346/2655] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:02:58.347293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.353739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf276c2-e148-4e14-bd09-3fab23d030ba admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.359599 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130c627-7e12-486b-a336-234f82418748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.360999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130c627-7e12-486b-a336-234f82418748 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.361439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130c627-7e12-486b-a336-234f82418748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.361726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130c627-7e12-486b-a336-234f82418748 admin admin] PATH_INFO: `/v3/projects/75d1be9c406e418c83a7b71d2506070d/users/d924398231da4b25ab60f436c2051791/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.362993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7f52-6a80-44fe-b512-c6a4b0b32c4c admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.363783 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130c627-7e12-486b-a336-234f82418748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d1be9c406e418c83a7b71d2506070d, user_id=d924398231da4b25ab60f436c2051791, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.367063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130c627-7e12-486b-a336-234f82418748 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.369221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fa165-b1e8-4134-895a-db7ba60becc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.370444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fa165-b1e8-4134-895a-db7ba60becc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.370734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fa165-b1e8-4134-895a-db7ba60becc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.371014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fa165-b1e8-4134-895a-db7ba60becc3 admin admin] PATH_INFO: `/v3/projects/c53c40898658413dbf20aafedaa6e277/users/7f88b83d655042be86174bc58783093e/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.378498 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1310/2656] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:58 2022] PUT /identity/v3/projects/75d1be9c406e418c83a7b71d2506070d/users/d924398231da4b25ab60f436c2051791/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:58.388628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fa165-b1e8-4134-895a-db7ba60becc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53c40898658413dbf20aafedaa6e277, user_id=7f88b83d655042be86174bc58783093e, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.391257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.391559 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.391689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fa165-b1e8-4134-895a-db7ba60becc3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.391835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.412666 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1347/2657] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:02:58 2022] PUT /identity/v3/projects/c53c40898658413dbf20aafedaa6e277/users/7f88b83d655042be86174bc58783093e/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:58.424500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] MFA Rules not processed for user `d924398231da4b25ab60f436c2051791`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:58.424923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ddc2d-83bf-404b-9df2-807ee4e10e64 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.425147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ddc2d-83bf-404b-9df2-807ee4e10e64 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.425457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ddc2d-83bf-404b-9df2-807ee4e10e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.426261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:58.455310 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a70ddc2d-83bf-404b-9df2-807ee4e10e64 None None] MFA Rules not processed for user `7f88b83d655042be86174bc58783093e`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:58.456491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a70ddc2d-83bf-404b-9df2-807ee4e10e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:58.466222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:58.510628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1311/2658] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:02:58.522430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.523869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:58.548695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1348/2659] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:58.586776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785848cb-30eb-4c3e-a450-8304d87cc831 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.590549 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.591201 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.591491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.591768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.601138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.602598 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.612573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1312/2660] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:58.682546 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ddc2d-83bf-404b-9df2-807ee4e10e64 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.692282 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ddc2d-83bf-404b-9df2-807ee4e10e64 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.696419 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331cad-ccd4-4165-bb32-7d2a1da9ddfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.697088 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331cad-ccd4-4165-bb32-7d2a1da9ddfd service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.697376 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331cad-ccd4-4165-bb32-7d2a1da9ddfd service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.697657 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331cad-ccd4-4165-bb32-7d2a1da9ddfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.705801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331cad-ccd4-4165-bb32-7d2a1da9ddfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.707222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331cad-ccd4-4165-bb32-7d2a1da9ddfd service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.715884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1349/2661] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:58.729128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:58.829397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd95a-caf1-4e18-aa30-9fcf80a1bf7b service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:58.836821 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:58.837809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.838265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.838608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] PATH_INFO: `/v3/users/7f88b83d655042be86174bc58783093e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:58.840166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f88b83d655042be86174bc58783093e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:58.842194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:58.867907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:58.935474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f88b83d655042be86174bc58783093e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:58.936505 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f88b83d655042be86174bc58783093e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:58.958946 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f88b83d655042be86174bc58783093e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:58.977472 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f88b83d655042be86174bc58783093e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:58.978160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f88b83d655042be86174bc58783093e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:58.991833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1313/2662] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:58 2022] DELETE /identity/v3/users/7f88b83d655042be86174bc58783093e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:58.996030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:58.996323 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:58.996630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.015151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:59.016346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.066171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.067681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.081107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1350/2663] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:59.090983 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.092365 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.137036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96c7f4-3bc1-4d19-9e74-84091bb076ad admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.141959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:59.142830 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.143111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.143383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] PATH_INFO: `/v3/users/35c092f90aee4b19a6459f226e62fad8` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.144661 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c092f90aee4b19a6459f226e62fad8)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:59.146820 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:59.153824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475984cb-9baf-4265-9d9d-02320ead18d4 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.157628 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb356e0b-9f99-456a-bda1-a7503053a410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:59.158305 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356e0b-9f99-456a-bda1-a7503053a410 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.158728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356e0b-9f99-456a-bda1-a7503053a410 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.158877 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356e0b-9f99-456a-bda1-a7503053a410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.168972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356e0b-9f99-456a-bda1-a7503053a410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:59.170585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356e0b-9f99-456a-bda1-a7503053a410 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:59.182197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1351/2664] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:02:59.198360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c092f90aee4b19a6459f226e62fad8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.199112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c092f90aee4b19a6459f226e62fad8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.219705 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c092f90aee4b19a6459f226e62fad8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.228221 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c092f90aee4b19a6459f226e62fad8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.229125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c092f90aee4b19a6459f226e62fad8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.243584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1314/2665] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:02:59 2022] DELETE /identity/v3/users/35c092f90aee4b19a6459f226e62fad8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:02:59.248766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.249277 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.249758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.268853 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:59.270068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.312547 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:59.346269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1352/2666] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:59.356211 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.358254 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.374652 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:59.433405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc590a86-ac36-40aa-8b66-357ac3c3adfc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.437867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af670b-5b4a-4948-b1a0-326cc1d2a581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:59.438713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af670b-5b4a-4948-b1a0-326cc1d2a581 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.439414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af670b-5b4a-4948-b1a0-326cc1d2a581 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.439414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af670b-5b4a-4948-b1a0-326cc1d2a581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.450615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af670b-5b4a-4948-b1a0-326cc1d2a581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:59.452235 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af670b-5b4a-4948-b1a0-326cc1d2a581 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:59.463611 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1315/2667] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:02:59.478390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.480713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.506583 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee71be-e7f9-4715-9bae-474fbc65d327 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.513599 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:59.514492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.514817 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.515084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] PATH_INFO: `/v3/projects/c53c40898658413dbf20aafedaa6e277` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.516359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53c40898658413dbf20aafedaa6e277)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:59.518372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:59.571445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53c40898658413dbf20aafedaa6e277', 'request_id': 'req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.577527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53c40898658413dbf20aafedaa6e277', 'request_id': 'req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.585341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53c40898658413dbf20aafedaa6e277', 'request_id': 'req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.597000 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] The token cache is being invalidate because project c53c40898658413dbf20aafedaa6e277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:59.597291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.597945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ffa22ec7-06c9-41a5-919e-3e9d6b9384ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.599553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1353/2668] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:59 2022] DELETE /identity/v3/projects/c53c40898658413dbf20aafedaa6e277 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:59.604374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252158-6e4f-4dfa-a4b5-62006c6d6327 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.604890 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252158-6e4f-4dfa-a4b5-62006c6d6327 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.604976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252158-6e4f-4dfa-a4b5-62006c6d6327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.625108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-01252158-6e4f-4dfa-a4b5-62006c6d6327 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:59.626327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-01252158-6e4f-4dfa-a4b5-62006c6d6327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.705764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1316/2669] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:59.713723 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.714245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.714347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.734937 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:02:59.736100 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.748864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1354/2670] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:02:59.751143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252158-6e4f-4dfa-a4b5-62006c6d6327 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.763301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252158-6e4f-4dfa-a4b5-62006c6d6327 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.769180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:59.770156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.770885 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.771251 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.772098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:02:59.772415 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:59.780346 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:59.781725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.783283 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.796486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1317/2671] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:02:59.801106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.806406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de801b-894a-4c7d-b3c2-f46008e812a1 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.812958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:59.813426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2639676-832d-458f-972b-00068c1bd2b1 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.814097 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.814452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.814808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] PATH_INFO: `/v3/projects/3522a2e913564f749b7564f4e855731f` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.816196 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3522a2e913564f749b7564f4e855731f)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:59.819213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:59.822128 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:02:59.823402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:02:59.823695 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:02:59.824111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:02:59.824889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:02:59.826817 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:02:59.862377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1318/2672] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:02:59 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:02:59.867887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.887315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3522a2e913564f749b7564f4e855731f', 'request_id': 'req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.909415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3522a2e913564f749b7564f4e855731f', 'request_id': 'req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.918686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3522a2e913564f749b7564f4e855731f', 'request_id': 'req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.933688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] The token cache is being invalidate because project 3522a2e913564f749b7564f4e855731f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:02:59.934071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.934802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:02:59.936788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1355/2673] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:02:59 2022] DELETE /identity/v3/projects/3522a2e913564f749b7564f4e855731f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:02:59.937636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:02:59.938996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:02:59.953654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311277cd-1e27-4b76-b7f5-35392d1e2c68 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:02:59.978291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:02:59.984030 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:00.001984 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf41df-2a56-47d9-ba7d-51bdc99025b9 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.005724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.006382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.006653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.006938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.008793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.014082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.014775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.015063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.015339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.016049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.018030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.020764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.022221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.032426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1356/2674] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:00.033333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.034900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.040175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1319/2675] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:02:59 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:03:00.044233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.045978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.050843 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438b6b-b53d-43c2-8cab-df8a418eeec6 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.056338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.057238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.057524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.057801 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] PATH_INFO: `/v3/users/d924398231da4b25ab60f436c2051791` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.058813 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e055d3-2fcf-4f02-b538-176b48ffeb32 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.058986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d924398231da4b25ab60f436c2051791)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.060923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.064142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.064848 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.065142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.065434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.066169 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.067829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.079018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1320/2676] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:03:00.085527 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.097105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aa0bd-513b-4642-ad29-00faffdf58b5 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.103238 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.104321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.104321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.104533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.105230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.106832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.118161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd924398231da4b25ab60f436c2051791'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.122468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1321/2677] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:03:00.126882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.128175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd924398231da4b25ab60f436c2051791'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.137041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0a330-df34-4c08-ae13-2ee913330ee2 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.142631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.143174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd924398231da4b25ab60f436c2051791'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.143454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.144392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.144392 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] PATH_INFO: `/v3/projects/6f2dad8a58ae4a5a8318fed682edfe8e/users/4d9e56492c9f4ba88353258ffa8fb927/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.144695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd924398231da4b25ab60f436c2051791'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.144790 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-f7790485-85db-4f27-a8d1-91bc2b5df210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd924398231da4b25ab60f436c2051791'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.162959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1357/2678] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:00 2022] DELETE /identity/v3/users/d924398231da4b25ab60f436c2051791 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:00.170267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2dad8a58ae4a5a8318fed682edfe8e, user_id=4d9e56492c9f4ba88353258ffa8fb927, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.173105 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.188767 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1322/2679] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:03:00 2022] PUT /identity/v3/projects/6f2dad8a58ae4a5a8318fed682edfe8e/users/4d9e56492c9f4ba88353258ffa8fb927/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:00.202708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.203064 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.203341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.240656 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] MFA Rules not processed for user `4d9e56492c9f4ba88353258ffa8fb927`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:00.241887 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.326406 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1358/2680] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:03:00.335907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.337511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.407255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005faf-ffae-4be2-b17b-8576a53d34e4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.412775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f2739-2102-4791-980b-d13d645dbe5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.413461 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f2739-2102-4791-980b-d13d645dbe5d service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.413738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f2739-2102-4791-980b-d13d645dbe5d service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.414025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f2739-2102-4791-980b-d13d645dbe5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.425113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f2739-2102-4791-980b-d13d645dbe5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.427132 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f2739-2102-4791-980b-d13d645dbe5d service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.437990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1323/2681] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:00.477619 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.479051 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.532487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:00.559347 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7db59-2956-4f2a-bec5-808fe749e14c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.564732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.566122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.566413 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.566702 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] PATH_INFO: `/v3/projects/75d1be9c406e418c83a7b71d2506070d` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.569105 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d1be9c406e418c83a7b71d2506070d)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.571802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.629648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d1be9c406e418c83a7b71d2506070d', 'request_id': 'req-0e57880c-bea7-437d-8fc2-fec840c317af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.641665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d1be9c406e418c83a7b71d2506070d', 'request_id': 'req-0e57880c-bea7-437d-8fc2-fec840c317af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.651691 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d1be9c406e418c83a7b71d2506070d', 'request_id': 'req-0e57880c-bea7-437d-8fc2-fec840c317af'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.671084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] The token cache is being invalidate because project 75d1be9c406e418c83a7b71d2506070d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:00.671084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.671718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-0e57880c-bea7-437d-8fc2-fec840c317af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:00.673744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1359/2682] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:00 2022] DELETE /identity/v3/projects/75d1be9c406e418c83a7b71d2506070d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:00.678726 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0513af-616f-462f-9d9a-fbacefe2da85 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.679259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0513af-616f-462f-9d9a-fbacefe2da85 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.679365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0513af-616f-462f-9d9a-fbacefe2da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.698562 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1e0513af-616f-462f-9d9a-fbacefe2da85 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:00.699765 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1e0513af-616f-462f-9d9a-fbacefe2da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.775754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1324/2683] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:00.785212 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3dc67-8a12-41a7-b227-57f7df002d8d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.785686 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3dc67-8a12-41a7-b227-57f7df002d8d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.785786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3dc67-8a12-41a7-b227-57f7df002d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.805593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-a7c3dc67-8a12-41a7-b227-57f7df002d8d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:00.807138 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a7c3dc67-8a12-41a7-b227-57f7df002d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:00.815200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1360/2684] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:00.820999 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0513af-616f-462f-9d9a-fbacefe2da85 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.831086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0513af-616f-462f-9d9a-fbacefe2da85 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.836615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.837297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.837581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.837945 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.838580 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:03:00.838896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.840520 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.849657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:00.854626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1325/2685] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 15:03:00.858833 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3dc67-8a12-41a7-b227-57f7df002d8d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.868191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3dc67-8a12-41a7-b227-57f7df002d8d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.872936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.873588 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.873878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.874161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.874861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.876789 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:00.909417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1361/2686] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:03:00 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:03:00.910896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:00.921456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c73ad-b78d-4668-93a9-b6758cee825a admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:00.981903 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:00.982584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:00.982871 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:00.983149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:00.983867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:00.985924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:01.010152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1326/2687] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:03:00 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:03:01.014755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:01.032865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3bec-0fdd-4000-863c-56cc952ec841 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:01.041041 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:01.041653 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:01.041943 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:01.042228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:01.042973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:01.044625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:01.058671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1362/2688] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:03:01.062910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:01.073727 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020c7a5-c8a0-40db-853b-1752d5682468 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:01.078863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5af4ab-bcc0-4680-9db0-0f161ccecb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:01.079545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5af4ab-bcc0-4680-9db0-0f161ccecb9a admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:01.079831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5af4ab-bcc0-4680-9db0-0f161ccecb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:01.080111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5af4ab-bcc0-4680-9db0-0f161ccecb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:01.080912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5af4ab-bcc0-4680-9db0-0f161ccecb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:01.082521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5af4ab-bcc0-4680-9db0-0f161ccecb9a admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:01.095471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1327/2689] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:03:01.098432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:01.110056 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e383c40-d9be-485e-bc9e-d6fc19037dd1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:01.115755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:01.116753 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:01.117060 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:01.117349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] PATH_INFO: `/v3/projects/39c3852392cc436397866c4fec41c2bc/users/cef3b8bf051b4fcc808ad8abab4a7238/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:01.136996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c3852392cc436397866c4fec41c2bc, user_id=cef3b8bf051b4fcc808ad8abab4a7238, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:01.141551 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:01.160867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1363/2690] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:03:01 2022] PUT /identity/v3/projects/39c3852392cc436397866c4fec41c2bc/users/cef3b8bf051b4fcc808ad8abab4a7238/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:01.172560 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:01.172902 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:01.173190 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:01.203189 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] MFA Rules not processed for user `cef3b8bf051b4fcc808ad8abab4a7238`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:01.204399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:01.276478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1328/2691] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:01.287649 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:01.289402 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:01.350885 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441311-aa22-4604-88bc-265f84d39247 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:01.354689 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:01.355346 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:01.355638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:01.355921 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:01.364442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:01.366034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:01.375061 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1364/2692] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:06.672878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:06.674320 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:06.745983 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c603e3-97f8-4b13-8d01-e10d8ee4eae8 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:06.750701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:06.751591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:06.751877 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:06.752156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] PATH_INFO: `/v3/users/c9a0569d0a7641a9858c0810219b1ef8` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:06.753414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a0569d0a7641a9858c0810219b1ef8)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:06.755391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:06.766009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:06.807718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a0569d0a7641a9858c0810219b1ef8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:06.808296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a0569d0a7641a9858c0810219b1ef8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:06.820192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a0569d0a7641a9858c0810219b1ef8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:06.827061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a0569d0a7641a9858c0810219b1ef8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:06.827702 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a0569d0a7641a9858c0810219b1ef8'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:06.841940 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1329/2693] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:06 2022] DELETE /identity/v3/users/c9a0569d0a7641a9858c0810219b1ef8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:07.024837 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:07.037150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194a791-7705-4bb8-b8a6-ec13cc25b7c8 service glance] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:07.048256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:07.102519 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:07.103313 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:07.103602 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:07.103886 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] PATH_INFO: `/v3/projects/379bba80af244096abbf8deb82772854` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:07.105222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=379bba80af244096abbf8deb82772854)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:07.107263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:07.158951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379bba80af244096abbf8deb82772854', 'request_id': 'req-ca9cb2d4-acf1-4208-97b0-eeb698758c63'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.166176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379bba80af244096abbf8deb82772854', 'request_id': 'req-ca9cb2d4-acf1-4208-97b0-eeb698758c63'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.173629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379bba80af244096abbf8deb82772854', 'request_id': 'req-ca9cb2d4-acf1-4208-97b0-eeb698758c63'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.185278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] The token cache is being invalidate because project 379bba80af244096abbf8deb82772854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:07.185578 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.186219 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.187774 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1365/2694] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:07 2022] DELETE /identity/v3/projects/379bba80af244096abbf8deb82772854 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:07.192191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:07.193781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:07.207414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae921303-53b1-4c71-a59b-e868687dc85f admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:07.264568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:07.265474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:07.265754 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:07.266031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] PATH_INFO: `/v3/users/57c14b0bd17049b684ecd0669b68d0e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:07.267249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c14b0bd17049b684ecd0669b68d0e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:07.269213 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:07.322835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c14b0bd17049b684ecd0669b68d0e5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.323501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c14b0bd17049b684ecd0669b68d0e5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.336441 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c14b0bd17049b684ecd0669b68d0e5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.343204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c14b0bd17049b684ecd0669b68d0e5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.343847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c14b0bd17049b684ecd0669b68d0e5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.356381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1330/2695] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:07 2022] DELETE /identity/v3/users/57c14b0bd17049b684ecd0669b68d0e5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:07.540971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:07.542435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:07.560842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb2d4-acf1-4208-97b0-eeb698758c63 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:07.620108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:07.620926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:07.621215 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:07.621494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] PATH_INFO: `/v3/projects/bfdbd39af6994a8586e0a589a3c9640e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:07.622693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdbd39af6994a8586e0a589a3c9640e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:07.624775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:07.670169 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:07.673763 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdbd39af6994a8586e0a589a3c9640e', 'request_id': 'req-96e19df7-a36d-492e-94bf-b3cee4728b9a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.681553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdbd39af6994a8586e0a589a3c9640e', 'request_id': 'req-96e19df7-a36d-492e-94bf-b3cee4728b9a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.691113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdbd39af6994a8586e0a589a3c9640e', 'request_id': 'req-96e19df7-a36d-492e-94bf-b3cee4728b9a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.703236 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] The token cache is being invalidate because project bfdbd39af6994a8586e0a589a3c9640e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:07.703532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.704168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-96e19df7-a36d-492e-94bf-b3cee4728b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:07.705745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1366/2696] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:07 2022] DELETE /identity/v3/projects/bfdbd39af6994a8586e0a589a3c9640e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:17.352826 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:DELETE=20,keystone:SELECT=75,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:17.700544 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:20.090496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:20.092608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:20.106866 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b5a2-3084-4719-9420-60e6b66c79e3 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:20.178253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:20.179531 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:20.180329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:20.180925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] PATH_INFO: `/v3/users/cef3b8bf051b4fcc808ad8abab4a7238` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:20.182389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef3b8bf051b4fcc808ad8abab4a7238)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:20.184774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:20.250354 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef3b8bf051b4fcc808ad8abab4a7238'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.251125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef3b8bf051b4fcc808ad8abab4a7238'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.267445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef3b8bf051b4fcc808ad8abab4a7238'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.277056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef3b8bf051b4fcc808ad8abab4a7238'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.277789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef3b8bf051b4fcc808ad8abab4a7238'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.293176 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1331/2697] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:20 2022] DELETE /identity/v3/users/cef3b8bf051b4fcc808ad8abab4a7238 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:20.297772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:20.298271 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:20.298386 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:20.317590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:20.318847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:20.393926 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1367/2698] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:03:20.405519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:20.406738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:20.467372 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82f21f-1d98-48ee-8181-914841590bf7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:20.471267 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9348e30-bd73-455a-bdf4-72b1de6061dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:20.471924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348e30-bd73-455a-bdf4-72b1de6061dd service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:20.472684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348e30-bd73-455a-bdf4-72b1de6061dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:20.472684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348e30-bd73-455a-bdf4-72b1de6061dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:20.483030 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9348e30-bd73-455a-bdf4-72b1de6061dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:20.484418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9348e30-bd73-455a-bdf4-72b1de6061dd service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:20.495198 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1332/2699] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:20.848333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:20.850037 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:20.876312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc469-663b-4fad-a9ac-4ad6d1c3ae30 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:20.881955 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:20.882641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:20.882999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:20.883285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] PATH_INFO: `/v3/projects/39c3852392cc436397866c4fec41c2bc` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:20.884573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c3852392cc436397866c4fec41c2bc)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:20.886589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:20.942893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c3852392cc436397866c4fec41c2bc', 'request_id': 'req-fb8ef4d6-dff7-4449-95d5-e591e59db983'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.950538 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c3852392cc436397866c4fec41c2bc', 'request_id': 'req-fb8ef4d6-dff7-4449-95d5-e591e59db983'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.959306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c3852392cc436397866c4fec41c2bc', 'request_id': 'req-fb8ef4d6-dff7-4449-95d5-e591e59db983'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.972654 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] The token cache is being invalidate because project 39c3852392cc436397866c4fec41c2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:20.972951 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.973620 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-fb8ef4d6-dff7-4449-95d5-e591e59db983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:20.975959 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1368/2700] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:20 2022] DELETE /identity/v3/projects/39c3852392cc436397866c4fec41c2bc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:20.980893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae8d0-efe1-4949-afed-358717e12b96 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:20.981246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae8d0-efe1-4949-afed-358717e12b96 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:20.981485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae8d0-efe1-4949-afed-358717e12b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.000368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-900ae8d0-efe1-4949-afed-358717e12b96 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:21.001747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-900ae8d0-efe1-4949-afed-358717e12b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:21.041939 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:21.099339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1333/2701] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:21.107623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e932f-464f-4e80-a42a-84c5eb3e6d30 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.107923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e932f-464f-4e80-a42a-84c5eb3e6d30 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.108211 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e932f-464f-4e80-a42a-84c5eb3e6d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.132981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5a7e932f-464f-4e80-a42a-84c5eb3e6d30 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:21.134210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5a7e932f-464f-4e80-a42a-84c5eb3e6d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:21.149089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1369/2702] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:21.153721 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae8d0-efe1-4949-afed-358717e12b96 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.164856 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae8d0-efe1-4949-afed-358717e12b96 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.170103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.170781 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.171069 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.171353 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.172087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:03:21.172406 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.174232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.186847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1334/2703] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:03:21.191040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e932f-464f-4e80-a42a-84c5eb3e6d30 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.204281 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e932f-464f-4e80-a42a-84c5eb3e6d30 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.212608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.212608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.212608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.212608 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.213050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.214736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.246414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1370/2704] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:03:21 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:03:21.250776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.260510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95615c-1b3f-4697-9f64-bc81e1f655b0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.336438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.337152 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.337434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.337710 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.338402 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.340625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.360910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.364642 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1335/2705] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:03:21 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:03:21.366978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.367895 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:21.378196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ba909-33df-42d5-8a76-e177e5b91523 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.384278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.385217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.385576 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.385974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.386473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37020-f3d9-463a-b708-f4c5ea789a2f admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.386896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.388568 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.392272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.393451 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.393818 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.394178 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] PATH_INFO: `/v3/users/4d9e56492c9f4ba88353258ffa8fb927` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.395993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9e56492c9f4ba88353258ffa8fb927)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.398898 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.400444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1336/2706] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:03:21.404572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.420237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81702bbb-b22a-44e9-bf07-30a3983a261e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.426635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.426823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.427116 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.427545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.428289 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.430949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.448780 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1337/2707] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:03:21.450738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.462444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5f86-8259-4cdc-9f4f-7d582ff5b967 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.471563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cd398-ca0d-4593-85f1-0bd5c31ea798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.473377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cd398-ca0d-4593-85f1-0bd5c31ea798 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.474036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cd398-ca0d-4593-85f1-0bd5c31ea798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.474490 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cd398-ca0d-4593-85f1-0bd5c31ea798 admin admin] PATH_INFO: `/v3/projects/f5b5dfa35337481eb0ad186143c4cf9a/users/247664375e9742aba16c98473d1d1460/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.476802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9e56492c9f4ba88353258ffa8fb927'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:21.480409 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:21.489623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9e56492c9f4ba88353258ffa8fb927'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:21.498551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cd398-ca0d-4593-85f1-0bd5c31ea798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b5dfa35337481eb0ad186143c4cf9a, user_id=247664375e9742aba16c98473d1d1460, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.503454 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cd398-ca0d-4593-85f1-0bd5c31ea798 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.508329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9e56492c9f4ba88353258ffa8fb927'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:21.509735 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9e56492c9f4ba88353258ffa8fb927'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:21.515452 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-494602d3-9b54-43b8-94bd-d48f993b8cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9e56492c9f4ba88353258ffa8fb927'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:21.523249 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1338/2708] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:03:21 2022] PUT /identity/v3/projects/f5b5dfa35337481eb0ad186143c4cf9a/users/247664375e9742aba16c98473d1d1460/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:21.535719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c55f-9913-4988-8458-7855128a9953 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.536006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c55f-9913-4988-8458-7855128a9953 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.536313 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c55f-9913-4988-8458-7855128a9953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.550080 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1371/2709] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:21 2022] DELETE /identity/v3/users/4d9e56492c9f4ba88353258ffa8fb927 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:21.556314 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.556751 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.557130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.568545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5103c55f-9913-4988-8458-7855128a9953 None None] MFA Rules not processed for user `247664375e9742aba16c98473d1d1460`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:21.569862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5103c55f-9913-4988-8458-7855128a9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:21.588755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:21.590174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:21.634477 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:21.697519 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1339/2710] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:21.702106 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c55f-9913-4988-8458-7855128a9953 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.704683 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5103c55f-9913-4988-8458-7855128a9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:21.712180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1372/2711] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:21.719492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.721408 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:21.724466 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c55f-9913-4988-8458-7855128a9953 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.731511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.732451 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.733296 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.733750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.736002 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.740261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.781446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1340/2712] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:03:21 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:03:21.797447 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.798589 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08394e-22f8-440e-8ca2-260e71b2ba8d None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.874564 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.875401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.875788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.876258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.892483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870602-25c3-47c4-9b2b-61ee34bb8d1f admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.900215 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.900941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.901341 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.901495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.902374 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.904538 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.929511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:21.935724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1341/2713] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:03:21 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:03:21.937026 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.950724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c74b-add4-41be-af9a-bb285b7c99ff admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.956786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:21.957485 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:21.957802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:21.958089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:21.959178 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.959508 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:21.962079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.962209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:21.974474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1342/2714] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:03:21.976806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1373/2715] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:21.978623 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:21.989792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f2771-065d-49fe-930a-f74c2852409d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:21.998800 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.000629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.000963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.001262 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] PATH_INFO: `/v3/projects/4eaddc798500463e93352b2a0d00109a/users/a62f6a757ea242d7a0c5de5a4927edf4/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.018271 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eaddc798500463e93352b2a0d00109a, user_id=a62f6a757ea242d7a0c5de5a4927edf4, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.021323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.035256 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1343/2716] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:03:21 2022] PUT /identity/v3/projects/4eaddc798500463e93352b2a0d00109a/users/a62f6a757ea242d7a0c5de5a4927edf4/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:22.039360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.049782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e6c2-523e-45cd-b880-bc30b9080077 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.124221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12142e-e140-43ec-add1-5dde0674d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.125167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12142e-e140-43ec-add1-5dde0674d49c admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.125448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12142e-e140-43ec-add1-5dde0674d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.125825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12142e-e140-43ec-add1-5dde0674d49c admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.126800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12142e-e140-43ec-add1-5dde0674d49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.128352 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12142e-e140-43ec-add1-5dde0674d49c admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.143469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1374/2717] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:03:22.148010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.159358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fd744-87fc-4ae6-ba9b-304279f6c83d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.167141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.168162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.168554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.168973 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] PATH_INFO: `/v3/projects/4eaddc798500463e93352b2a0d00109a/users/a62f6a757ea242d7a0c5de5a4927edf4/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.171154 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eaddc798500463e93352b2a0d00109a, user_id=a62f6a757ea242d7a0c5de5a4927edf4, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.174635 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.200253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1344/2718] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:03:22 2022] PUT /identity/v3/projects/4eaddc798500463e93352b2a0d00109a/users/a62f6a757ea242d7a0c5de5a4927edf4/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:03:22.211688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.211981 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.212263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.243536 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] MFA Rules not processed for user `a62f6a757ea242d7a0c5de5a4927edf4`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:22.245349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:22.287482 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.291130 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:22.355289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1375/2719] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:22.363603 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.365151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:22.384480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01693b3c-0711-4414-9881-4b794716f3c7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.390385 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.391292 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.391561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.392456 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] PATH_INFO: `/v3/projects/6f2dad8a58ae4a5a8318fed682edfe8e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.393414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2dad8a58ae4a5a8318fed682edfe8e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.395628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.399127 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:22.440200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f6ba1-d9af-4d64-83ce-9a4fedaac9d7 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.444996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bbdf5-97b5-4b16-8aa9-1f7ba87ac850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.445797 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bbdf5-97b5-4b16-8aa9-1f7ba87ac850 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.446185 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bbdf5-97b5-4b16-8aa9-1f7ba87ac850 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.446568 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bbdf5-97b5-4b16-8aa9-1f7ba87ac850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.456807 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=100 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:22.459438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2dad8a58ae4a5a8318fed682edfe8e', 'request_id': 'req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:22.467120 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2dad8a58ae4a5a8318fed682edfe8e', 'request_id': 'req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:22.474896 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2dad8a58ae4a5a8318fed682edfe8e', 'request_id': 'req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:22.488573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] The token cache is being invalidate because project 6f2dad8a58ae4a5a8318fed682edfe8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:22.488882 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:22.489587 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-8b2d619e-7970-4e8f-8c1a-baafcefce9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:22.491771 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1345/2720] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:22 2022] DELETE /identity/v3/projects/6f2dad8a58ae4a5a8318fed682edfe8e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:22.497207 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80ae3-25f8-42a4-aa02-4928630ca19a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.497512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80ae3-25f8-42a4-aa02-4928630ca19a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.497796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80ae3-25f8-42a4-aa02-4928630ca19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.519833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-fef80ae3-25f8-42a4-aa02-4928630ca19a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:22.521091 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-fef80ae3-25f8-42a4-aa02-4928630ca19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:22.521434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bbdf5-97b5-4b16-8aa9-1f7ba87ac850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.523417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bbdf5-97b5-4b16-8aa9-1f7ba87ac850 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.533590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1376/2721] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:22.609159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1346/2722] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:03:22.610839 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e442-7a7b-4d84-b323-432ecd08cb21 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.611131 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e442-7a7b-4d84-b323-432ecd08cb21 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.611414 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e442-7a7b-4d84-b323-432ecd08cb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.632570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-7253e442-7a7b-4d84-b323-432ecd08cb21 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:22.633769 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7253e442-7a7b-4d84-b323-432ecd08cb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:22.645192 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1377/2723] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:22.648947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80ae3-25f8-42a4-aa02-4928630ca19a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.661419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80ae3-25f8-42a4-aa02-4928630ca19a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.668111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.668963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.669327 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.669687 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.670637 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:03:22.671230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.673446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.689909 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1347/2724] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:03:22.694779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253e442-7a7b-4d84-b323-432ecd08cb21 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.705362 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253e442-7a7b-4d84-b323-432ecd08cb21 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.713101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.714218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.714359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.714530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.715274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.717197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.751048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1378/2725] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:03:22 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:03:22.754923 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.766502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4027-a120-4f41-bbfe-c4f1233ce559 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.839381 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.839833 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.840217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.841014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.842284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.844486 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.877383 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1348/2726] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:03:22 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:03:22.878101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.898501 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3eafa-a7d7-4e27-813b-13f80474bf83 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.904403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.905727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.906079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.906426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.907231 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.909364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.925647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1379/2727] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:03:22.930729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.944985 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd4945-81ed-49a6-b865-95727335113c admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.952605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e61f9-39a0-4d69-83bd-3abef4a7ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.953608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e61f9-39a0-4d69-83bd-3abef4a7ff85 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.953951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e61f9-39a0-4d69-83bd-3abef4a7ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.954286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e61f9-39a0-4d69-83bd-3abef4a7ff85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:22.955110 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e61f9-39a0-4d69-83bd-3abef4a7ff85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:22.957136 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e61f9-39a0-4d69-83bd-3abef4a7ff85 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:22.959631 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:22.977414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1349/2728] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:03:22.980570 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:22.991977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fcd64-56b8-4356-b45a-b31441643c26 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:22.996527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:22.997456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:22.997740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:22.998014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] PATH_INFO: `/v3/projects/c89ca5c31d404db4b7b38c4267e84047/users/ae3ca7b2742f419d9104214414da111a/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:23.013186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89ca5c31d404db4b7b38c4267e84047, user_id=ae3ca7b2742f419d9104214414da111a, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:23.015913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:23.029973 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1380/2729] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:03:22 2022] PUT /identity/v3/projects/c89ca5c31d404db4b7b38c4267e84047/users/ae3ca7b2742f419d9104214414da111a/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:23.040414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d5789-b4a1-4af9-b3e6-18baf9497d0a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:23.040744 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d5789-b4a1-4af9-b3e6-18baf9497d0a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:23.041031 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d5789-b4a1-4af9-b3e6-18baf9497d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:23.069834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-144d5789-b4a1-4af9-b3e6-18baf9497d0a None None] MFA Rules not processed for user `ae3ca7b2742f419d9104214414da111a`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:23.071060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-144d5789-b4a1-4af9-b3e6-18baf9497d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:23.144867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1350/2730] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:23.153648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:23.155401 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:23.220970 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6edb11-4497-4764-af1b-4a56e7376ef3 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:23.224858 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:23.226081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:23.226368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:23.226648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:23.235425 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:23.237555 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:23.248572 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1381/2731] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:23.605938 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6c9f2-6ac1-4acb-8e96-55a2e004ddf2 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:23.606458 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6c9f2-6ac1-4acb-8e96-55a2e004ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:23.606584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6c9f2-6ac1-4acb-8e96-55a2e004ddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:23.624396 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c6d6c9f2-6ac1-4acb-8e96-55a2e004ddf2 None None] MFA Rules not processed for user `a21b520b8aaa45538f59ceeab4ec9d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:23.625608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c6d6c9f2-6ac1-4acb-8e96-55a2e004ddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:23.680366 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1351/2732] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:25.137457 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:25.138932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:25.197651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:25.216749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330bec-b009-432c-8335-be71a6b1f24d service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:25.221813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:25.222852 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:25.223267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:25.223552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] PATH_INFO: `/v3/users/247664375e9742aba16c98473d1d1460` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:25.224799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247664375e9742aba16c98473d1d1460)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:25.226830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:25.287045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247664375e9742aba16c98473d1d1460'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.296318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247664375e9742aba16c98473d1d1460'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.311915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247664375e9742aba16c98473d1d1460'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.313198 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247664375e9742aba16c98473d1d1460'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.313331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247664375e9742aba16c98473d1d1460'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.328783 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1382/2733] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:25 2022] DELETE /identity/v3/users/247664375e9742aba16c98473d1d1460 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:25.334916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:25.335446 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:25.335597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:25.353818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:25.355164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:25.442722 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1352/2734] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:25.452696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:25.454134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:25.512727 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473963b4-4a84-49fb-b55e-6e553e5a6b79 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:25.516503 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:25.517182 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:25.517471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:25.517754 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:25.527164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:25.528663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:25.539151 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1383/2735] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:25.830335 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:25.831770 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:25.845057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a02281-5a44-4d39-a084-04ee4083ca42 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:25.851900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:25.853501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:25.854054 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:25.854416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] PATH_INFO: `/v3/projects/f5b5dfa35337481eb0ad186143c4cf9a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:25.855943 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b5dfa35337481eb0ad186143c4cf9a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:25.858253 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:25.891837 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:25.908960 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b5dfa35337481eb0ad186143c4cf9a', 'request_id': 'req-44b9bdfd-7450-486a-afd2-8e435f98fec4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.917715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b5dfa35337481eb0ad186143c4cf9a', 'request_id': 'req-44b9bdfd-7450-486a-afd2-8e435f98fec4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.925252 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b5dfa35337481eb0ad186143c4cf9a', 'request_id': 'req-44b9bdfd-7450-486a-afd2-8e435f98fec4'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.937450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] The token cache is being invalidate because project f5b5dfa35337481eb0ad186143c4cf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:25.937741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.938379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:25.940102 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1353/2736] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:25 2022] DELETE /identity/v3/projects/f5b5dfa35337481eb0ad186143c4cf9a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:25.944084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:25.954635 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0eae-066d-45dd-a3fd-7ceaa034be8b service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:26.012631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:26.013513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:26.013799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:26.014081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] PATH_INFO: `/v3/users/a62f6a757ea242d7a0c5de5a4927edf4` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:26.015274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62f6a757ea242d7a0c5de5a4927edf4)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:26.017368 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:26.034262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:26.074913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62f6a757ea242d7a0c5de5a4927edf4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.088172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62f6a757ea242d7a0c5de5a4927edf4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.104034 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62f6a757ea242d7a0c5de5a4927edf4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.105115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62f6a757ea242d7a0c5de5a4927edf4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.105896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62f6a757ea242d7a0c5de5a4927edf4'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.125500 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1384/2737] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:25 2022] DELETE /identity/v3/users/a62f6a757ea242d7a0c5de5a4927edf4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:26.475798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:26.477258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:26.503749 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9bdfd-7450-486a-afd2-8e435f98fec4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:26.607037 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:26.608007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:26.608696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:26.608846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] PATH_INFO: `/v3/projects/4eaddc798500463e93352b2a0d00109a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:26.610134 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eaddc798500463e93352b2a0d00109a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:26.612148 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:26.676542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eaddc798500463e93352b2a0d00109a', 'request_id': 'req-ac7c9b87-0952-4a0f-87eb-80d25125aad0'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.685261 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eaddc798500463e93352b2a0d00109a', 'request_id': 'req-ac7c9b87-0952-4a0f-87eb-80d25125aad0'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.692644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eaddc798500463e93352b2a0d00109a', 'request_id': 'req-ac7c9b87-0952-4a0f-87eb-80d25125aad0'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.704397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] The token cache is being invalidate because project 4eaddc798500463e93352b2a0d00109a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:26.704752 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.705418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:26.707605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1354/2738] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:26 2022] DELETE /identity/v3/projects/4eaddc798500463e93352b2a0d00109a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:36.118585 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:36.701473 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:47.347249 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:47.348941 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:47.416687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f06364-90cd-4217-9c58-980acf8f8eca admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:47.476493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74756f2-f835-4e9d-871f-ee9f333a03d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:47.477238 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74756f2-f835-4e9d-871f-ee9f333a03d9 service placement] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:47.477527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74756f2-f835-4e9d-871f-ee9f333a03d9 service placement] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:47.477815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74756f2-f835-4e9d-871f-ee9f333a03d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:47.479611 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a74756f2-f835-4e9d-871f-ee9f333a03d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:47.491122 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74756f2-f835-4e9d-871f-ee9f333a03d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:47.492739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74756f2-f835-4e9d-871f-ee9f333a03d9 service placement] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:47.502447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1385/2739] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:57.075879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:57.078122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:57.145174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9b87-0952-4a0f-87eb-80d25125aad0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:57.150237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:57.151109 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:57.151391 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:57.151668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] PATH_INFO: `/v3/users/ae3ca7b2742f419d9104214414da111a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:57.152908 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3ca7b2742f419d9104214414da111a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:57.154789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:57.199978 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3ca7b2742f419d9104214414da111a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.200656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3ca7b2742f419d9104214414da111a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.213629 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3ca7b2742f419d9104214414da111a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.220641 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3ca7b2742f419d9104214414da111a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.221301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3ca7b2742f419d9104214414da111a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.234232 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1355/2740] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:03:57 2022] DELETE /identity/v3/users/ae3ca7b2742f419d9104214414da111a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:03:57.238744 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:57.239213 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:57.239336 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:57.257189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:03:57.258385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:57.316329 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1386/2741] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:03:57.326045 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:57.327554 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:57.383929 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b1470-d8a0-432e-a83a-06731162de44 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:57.387640 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cd8e4-2787-4fb4-ab6c-2c8cf37196e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:57.388286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd8e4-2787-4fb4-ab6c-2c8cf37196e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:57.388570 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd8e4-2787-4fb4-ab6c-2c8cf37196e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:57.388879 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd8e4-2787-4fb4-ab6c-2c8cf37196e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:57.398739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cd8e4-2787-4fb4-ab6c-2c8cf37196e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:57.400234 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cd8e4-2787-4fb4-ab6c-2c8cf37196e6 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:57.410779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1356/2742] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:03:57.677209 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:03:57.678621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:03:57.690957 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf3025-094f-41c2-be31-a0b388b67e29 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:03:57.696396 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:03:57.697360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:03:57.697652 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:03:57.697939 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] PATH_INFO: `/v3/projects/c89ca5c31d404db4b7b38c4267e84047` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:03:57.699170 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89ca5c31d404db4b7b38c4267e84047)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:03:57.701124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:03:57.733901 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:03:57.749333 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89ca5c31d404db4b7b38c4267e84047', 'request_id': 'req-cb39cb25-4418-4847-b077-9c6b3d04b3bc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.754932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89ca5c31d404db4b7b38c4267e84047', 'request_id': 'req-cb39cb25-4418-4847-b077-9c6b3d04b3bc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.762006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89ca5c31d404db4b7b38c4267e84047', 'request_id': 'req-cb39cb25-4418-4847-b077-9c6b3d04b3bc'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.773444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] The token cache is being invalidate because project c89ca5c31d404db4b7b38c4267e84047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:03:57.773736 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.774390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-cb39cb25-4418-4847-b077-9c6b3d04b3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:03:57.775929 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1387/2743] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:03:57 2022] DELETE /identity/v3/projects/c89ca5c31d404db4b7b38c4267e84047 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:04:07.406164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:07.770146 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:25.178047 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:04:25.178595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:04:25.178595 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:04:25.196648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] MFA Rules not processed for user `b1a4f9ee8de446fe989b4d91ea0315e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:04:25.197864 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:04:25.272046 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1357/2744] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:04:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:04:28.553828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59071f-eacd-4806-976a-fcb45998d4b2 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:04:28.554446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59071f-eacd-4806-976a-fcb45998d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:04:28.554446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59071f-eacd-4806-976a-fcb45998d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:04:28.574840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-db59071f-eacd-4806-976a-fcb45998d4b2 None None] MFA Rules not processed for user `a21b520b8aaa45538f59ceeab4ec9d17`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:04:28.576255 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-db59071f-eacd-4806-976a-fcb45998d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:04:28.651595 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1388/2745] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:04:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:04:35.261590 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=25 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:04:38.640772 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=25 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:36.602607 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:36.604141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:36.676976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294eae-895e-4e67-874e-a6b0a7f8257f None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:36.682034 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:36.682955 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:36.683241 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:36.683521 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] PATH_INFO: `/v3/users/a21b520b8aaa45538f59ceeab4ec9d17` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:36.684809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21b520b8aaa45538f59ceeab4ec9d17)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:36.686805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:36.740436 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21b520b8aaa45538f59ceeab4ec9d17'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:36.741163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21b520b8aaa45538f59ceeab4ec9d17'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:36.754281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21b520b8aaa45538f59ceeab4ec9d17'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:36.761682 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21b520b8aaa45538f59ceeab4ec9d17'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:36.762430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9ab7dc71-e520-4ab1-9d3e-2601420f3b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21b520b8aaa45538f59ceeab4ec9d17'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:36.776227 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1358/2746] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:05:36 2022] DELETE /identity/v3/users/a21b520b8aaa45538f59ceeab4ec9d17 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:36.949641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59071f-eacd-4806-976a-fcb45998d4b2 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:36.963133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59071f-eacd-4806-976a-fcb45998d4b2 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.026639 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.027509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.027796 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.028077 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] PATH_INFO: `/v3/projects/0d032e462665466d83ab51e9c116d1e0` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.029297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d032e462665466d83ab51e9c116d1e0)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.031190 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.078715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d032e462665466d83ab51e9c116d1e0', 'request_id': 'req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:37.085147 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d032e462665466d83ab51e9c116d1e0', 'request_id': 'req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:37.092856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d032e462665466d83ab51e9c116d1e0', 'request_id': 'req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:37.104947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] The token cache is being invalidate because project 0d032e462665466d83ab51e9c116d1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:05:37.105241 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:37.105903 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-6fcb09d2-91f4-4fce-9712-6ad021dd22e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:37.107444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1389/2747] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:05:36 2022] DELETE /identity/v3/projects/0d032e462665466d83ab51e9c116d1e0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:05:37.113051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982fbbc-8af2-4c2b-9808-651b483a470c None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.113491 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982fbbc-8af2-4c2b-9808-651b483a470c None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.113665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982fbbc-8af2-4c2b-9808-651b483a470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.131467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-d982fbbc-8af2-4c2b-9808-651b483a470c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:37.132758 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-d982fbbc-8af2-4c2b-9808-651b483a470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:37.193122 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1359/2748] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:37.201044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2beb-382a-4d5d-8261-de9e35b692b3 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.201335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2beb-382a-4d5d-8261-de9e35b692b3 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.201618 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2beb-382a-4d5d-8261-de9e35b692b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.219756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-389f2beb-382a-4d5d-8261-de9e35b692b3 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:37.220985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-389f2beb-382a-4d5d-8261-de9e35b692b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:37.228820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1390/2749] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:37.232900 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982fbbc-8af2-4c2b-9808-651b483a470c None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.243379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982fbbc-8af2-4c2b-9808-651b483a470c None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.248035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.248763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.249073 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.249359 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.250086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:05:37.250397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.252651 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.264257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1360/2750] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:05:37.268644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f2beb-382a-4d5d-8261-de9e35b692b3 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.277788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f2beb-382a-4d5d-8261-de9e35b692b3 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.282989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.283630 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.283914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.284187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.284910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.286785 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.311289 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1391/2751] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:05:37 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:37.315719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.325657 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c44ce-b556-46c8-a862-3917e759b3f2 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.329180 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:37.382723 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.383386 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.383670 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.383949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.384666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.386608 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.405433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1361/2752] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:05:37 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:05:37.409944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.419823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fbc8f-08e0-4e30-8df4-cf826ebb45cd admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.424460 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.425139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.425426 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.425703 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.426417 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.427991 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.438388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1392/2753] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:37.442468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.452158 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6eea3-585b-48c4-b443-7314642ca8f7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.456851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee1da3-218b-410e-a233-8e95778bf450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.457501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee1da3-218b-410e-a233-8e95778bf450 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.457788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee1da3-218b-410e-a233-8e95778bf450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.458068 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee1da3-218b-410e-a233-8e95778bf450 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.458790 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee1da3-218b-410e-a233-8e95778bf450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.460362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee1da3-218b-410e-a233-8e95778bf450 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.470768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1362/2754] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:37.475220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.485446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f0fc1-5c97-4caa-a09c-2b8f1fe0505d admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.490638 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.491527 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.491946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.492164 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] PATH_INFO: `/v3/projects/b05cffa42b644886ac3b62f48aca83a3/users/8574b97af93741638e9dd3f9846470d5/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.507222 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05cffa42b644886ac3b62f48aca83a3, user_id=8574b97af93741638e9dd3f9846470d5, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.509877 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.522742 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1393/2755] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:37 2022] PUT /identity/v3/projects/b05cffa42b644886ac3b62f48aca83a3/users/8574b97af93741638e9dd3f9846470d5/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:37.532844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fda4ad-8786-4c91-a88a-f70854e55d24 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.533142 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fda4ad-8786-4c91-a88a-f70854e55d24 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.533424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fda4ad-8786-4c91-a88a-f70854e55d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.559510 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-e3fda4ad-8786-4c91-a88a-f70854e55d24 None None] MFA Rules not processed for user `8574b97af93741638e9dd3f9846470d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:37.560750 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e3fda4ad-8786-4c91-a88a-f70854e55d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:37.624177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1363/2756] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:37.629022 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.659631 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:37.699101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac3e25-c3a3-4494-b5a6-1873bfc0ca2a admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.703741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.705001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.705284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.705561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.706256 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.708171 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.732861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1394/2757] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:05:37 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:37.737003 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fda4ad-8786-4c91-a88a-f70854e55d24 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.747586 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fda4ad-8786-4c91-a88a-f70854e55d24 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.802594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.803264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.803546 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.803823 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.804791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.806701 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.826944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1364/2758] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:05:37 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:37.831520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.842136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935c550-0fc1-47f8-8c51-55939aa4d766 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.847456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.848119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.848407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.848718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.849446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.851096 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.861799 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1395/2759] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:37.866049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.872349 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:37.876219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c160-5d27-45c8-97e8-f83ef30be4c0 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.882163 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.883053 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.883345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.883628 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] PATH_INFO: `/v3/projects/289ca990f4df42cfa0e1c796b31554b1/users/15cd80d3a03240e29a302a27428f7e8a/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.898853 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289ca990f4df42cfa0e1c796b31554b1, user_id=15cd80d3a03240e29a302a27428f7e8a, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.901575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.914117 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1365/2760] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:37 2022] PUT /identity/v3/projects/289ca990f4df42cfa0e1c796b31554b1/users/15cd80d3a03240e29a302a27428f7e8a/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:05:37.917972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:37.928311 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15b4cb-002b-4cad-9370-726055cc1d4e admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:37.984135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf3be8-a99d-4411-89be-6e21cf53b05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:37.984814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3be8-a99d-4411-89be-6e21cf53b05d admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:37.985099 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3be8-a99d-4411-89be-6e21cf53b05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:37.985399 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3be8-a99d-4411-89be-6e21cf53b05d admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:37.986119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf3be8-a99d-4411-89be-6e21cf53b05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:37.987693 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf3be8-a99d-4411-89be-6e21cf53b05d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:37.997200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1396/2761] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:38.001689 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:38.012475 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36099fd-55e0-42a2-a6cf-3b5608e26b23 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:38.017887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:38.018769 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:38.019056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:38.019339 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] PATH_INFO: `/v3/projects/289ca990f4df42cfa0e1c796b31554b1/users/15cd80d3a03240e29a302a27428f7e8a/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:38.021328 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=289ca990f4df42cfa0e1c796b31554b1, user_id=15cd80d3a03240e29a302a27428f7e8a, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:38.023984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:38.035332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1366/2762] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:38 2022] PUT /identity/v3/projects/289ca990f4df42cfa0e1c796b31554b1/users/15cd80d3a03240e29a302a27428f7e8a/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:38.049384 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf25f8-8c54-411d-afaa-6008b4759de5 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:38.049688 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf25f8-8c54-411d-afaa-6008b4759de5 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:38.049977 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf25f8-8c54-411d-afaa-6008b4759de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:38.076663 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ceaf25f8-8c54-411d-afaa-6008b4759de5 None None] MFA Rules not processed for user `15cd80d3a03240e29a302a27428f7e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:38.077882 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ceaf25f8-8c54-411d-afaa-6008b4759de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:38.148469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1397/2763] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:38.159555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:38.161303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:38.219564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bca94b-833a-447e-9581-a0c876a5df2e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:38.223867 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:38.224545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:38.224862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:38.225144 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:38.233977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:38.235497 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:38.244824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1367/2764] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:05:38.317986 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf25f8-8c54-411d-afaa-6008b4759de5 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:38.327665 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf25f8-8c54-411d-afaa-6008b4759de5 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:38.331372 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabe8b0-be8d-4952-8954-f789d89630ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:38.332008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe8b0-be8d-4952-8954-f789d89630ee service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:38.332297 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe8b0-be8d-4952-8954-f789d89630ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:38.332593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabe8b0-be8d-4952-8954-f789d89630ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:38.352985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:38.392261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabe8b0-be8d-4952-8954-f789d89630ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:38.393740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabe8b0-be8d-4952-8954-f789d89630ee service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:38.402647 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1398/2765] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:05:47.166331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:47.230378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5ffd-54d8-4a0e-b43a-feed2191e06c service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:47.234967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:47.235851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:47.236141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:47.236504 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] PATH_INFO: `/v3/users/8574b97af93741638e9dd3f9846470d5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:47.237731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8574b97af93741638e9dd3f9846470d5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:47.239664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:47.285952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8574b97af93741638e9dd3f9846470d5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:47.286616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8574b97af93741638e9dd3f9846470d5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:47.299113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8574b97af93741638e9dd3f9846470d5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:47.304942 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:47.307040 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8574b97af93741638e9dd3f9846470d5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:47.307964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8574b97af93741638e9dd3f9846470d5'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:47.323023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1368/2766] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:05:47 2022] DELETE /identity/v3/users/8574b97af93741638e9dd3f9846470d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:47.327629 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:47.328090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:47.328208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:47.345383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:47.347101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:47.404244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1399/2767] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:47.414574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:47.416011 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:47.479966 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0293b8-2403-454d-b6fc-e2c2e97d0dd6 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:47.483663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:47.484314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:47.484632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:47.485605 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:47.498643 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:47.500094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:47.510233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1369/2768] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:05:48.029923 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:48.031449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:48.046006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c9a8-e5b6-47f8-b0db-d42ba1fe7c7c None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:48.052788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:48.053707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:48.053995 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:48.054375 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] PATH_INFO: `/v3/projects/b05cffa42b644886ac3b62f48aca83a3` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:48.056274 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05cffa42b644886ac3b62f48aca83a3)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:48.058341 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:48.108557 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05cffa42b644886ac3b62f48aca83a3', 'request_id': 'req-3165e0e1-4dac-40e5-8200-c5574f7427fe'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.114338 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05cffa42b644886ac3b62f48aca83a3', 'request_id': 'req-3165e0e1-4dac-40e5-8200-c5574f7427fe'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.123946 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05cffa42b644886ac3b62f48aca83a3', 'request_id': 'req-3165e0e1-4dac-40e5-8200-c5574f7427fe'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.138548 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] The token cache is being invalidate because project b05cffa42b644886ac3b62f48aca83a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:05:48.138842 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.139517 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.141875 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1400/2769] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:05:48 2022] DELETE /identity/v3/projects/b05cffa42b644886ac3b62f48aca83a3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:48.145949 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:48.155707 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6942-042c-4db6-8cf4-39c372d67c54 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:48.215947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:48.216912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:48.217196 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:48.217471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] PATH_INFO: `/v3/users/15cd80d3a03240e29a302a27428f7e8a` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:48.218676 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cd80d3a03240e29a302a27428f7e8a)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:48.220699 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:48.268663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cd80d3a03240e29a302a27428f7e8a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.269319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cd80d3a03240e29a302a27428f7e8a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.281738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cd80d3a03240e29a302a27428f7e8a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.288880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cd80d3a03240e29a302a27428f7e8a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.289553 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-dd99f2b7-e84f-4608-b981-fea16e42edca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cd80d3a03240e29a302a27428f7e8a'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.303906 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1370/2770] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:05:48 2022] DELETE /identity/v3/users/15cd80d3a03240e29a302a27428f7e8a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:48.723487 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:48.725050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:48.738125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165e0e1-4dac-40e5-8200-c5574f7427fe admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:48.785524 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:48.802360 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:48.803233 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:48.803520 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:48.803802 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] PATH_INFO: `/v3/projects/289ca990f4df42cfa0e1c796b31554b1` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:48.805286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=289ca990f4df42cfa0e1c796b31554b1)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:48.807285 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:48.854370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289ca990f4df42cfa0e1c796b31554b1', 'request_id': 'req-22d151c4-69ad-4d0a-8233-f520d43e2c6d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.860014 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289ca990f4df42cfa0e1c796b31554b1', 'request_id': 'req-22d151c4-69ad-4d0a-8233-f520d43e2c6d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.867162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289ca990f4df42cfa0e1c796b31554b1', 'request_id': 'req-22d151c4-69ad-4d0a-8233-f520d43e2c6d'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.878820 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] The token cache is being invalidate because project 289ca990f4df42cfa0e1c796b31554b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:05:48.879115 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.879780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-22d151c4-69ad-4d0a-8233-f520d43e2c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:48.881351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1401/2771] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:05:48 2022] DELETE /identity/v3/projects/289ca990f4df42cfa0e1c796b31554b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:48.886405 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058d74-e69e-4b1b-9564-1d65e5504b95 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:48.886716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058d74-e69e-4b1b-9564-1d65e5504b95 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:48.886976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058d74-e69e-4b1b-9564-1d65e5504b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:48.905000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5c058d74-e69e-4b1b-9564-1d65e5504b95 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:48.906245 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5c058d74-e69e-4b1b-9564-1d65e5504b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:48.911429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:48.970309 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1371/2772] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:48.982048 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3004f90-117d-4231-8825-8d754e6e5eef None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:48.982345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3004f90-117d-4231-8825-8d754e6e5eef None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:48.982779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3004f90-117d-4231-8825-8d754e6e5eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.002124 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b3004f90-117d-4231-8825-8d754e6e5eef None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:49.003334 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b3004f90-117d-4231-8825-8d754e6e5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:49.011295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1402/2773] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:49.015617 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c058d74-e69e-4b1b-9564-1d65e5504b95 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.025290 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c058d74-e69e-4b1b-9564-1d65e5504b95 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.030036 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.030697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.030984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.031259 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.031986 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:05:49.032329 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.034008 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.045513 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1372/2774] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:05:49.050644 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3004f90-117d-4231-8825-8d754e6e5eef None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.060273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3004f90-117d-4231-8825-8d754e6e5eef None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.065621 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.066269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.066559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.066840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.067540 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.069478 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.093980 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1403/2775] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:49.098281 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.108338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d3242-f8fd-4fa3-9bfd-f3b230bdeff4 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.163951 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.164644 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.164931 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.165203 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.165891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.167796 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.187530 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1373/2776] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:49.192272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.202486 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312636b7-970e-4f9e-bb43-c41dbed1f1a5 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.208133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.208916 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.209278 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.209636 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.210447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.212125 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.223553 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1404/2777] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:49.227439 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.237566 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddd991-edbd-49fb-a2df-1aa480c86ecc admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.242205 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b940759-b135-401b-bfc0-12d229ab70af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.242869 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940759-b135-401b-bfc0-12d229ab70af admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.243159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940759-b135-401b-bfc0-12d229ab70af admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.243445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940759-b135-401b-bfc0-12d229ab70af admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.244173 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b940759-b135-401b-bfc0-12d229ab70af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.245802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b940759-b135-401b-bfc0-12d229ab70af admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.256066 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1374/2778] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:49.260083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.270669 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791efe3-38bb-4113-b185-26c8461b2481 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.275415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.276291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.276593 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.276884 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] PATH_INFO: `/v3/projects/ee3429e6b564411fbb54de01733ba1da/users/60d1206041f54aaf8fe95b378aa866f3/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.292113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3429e6b564411fbb54de01733ba1da, user_id=60d1206041f54aaf8fe95b378aa866f3, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.294786 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.308055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1405/2779] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:49 2022] PUT /identity/v3/projects/ee3429e6b564411fbb54de01733ba1da/users/60d1206041f54aaf8fe95b378aa866f3/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:05:49.318735 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254074e-cd6b-4585-a44f-3c81f24ac356 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.318997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254074e-cd6b-4585-a44f-3c81f24ac356 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.319283 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254074e-cd6b-4585-a44f-3c81f24ac356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.349431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-a254074e-cd6b-4585-a44f-3c81f24ac356 None None] MFA Rules not processed for user `60d1206041f54aaf8fe95b378aa866f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:49.350664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a254074e-cd6b-4585-a44f-3c81f24ac356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:49.413654 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1375/2780] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:49.418530 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.479385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4175d-c4ed-4eb2-bce8-aa46d6a153e5 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.484001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.484678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.485550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.485825 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.486511 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.488385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.502312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:49.515065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1406/2781] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:05:49.519775 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254074e-cd6b-4585-a44f-3c81f24ac356 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.530625 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254074e-cd6b-4585-a44f-3c81f24ac356 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.534788 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:49.590668 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.591285 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.591574 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.591855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.592552 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.594578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.616514 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1376/2782] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:49.620695 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.631857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98708ae-d2fc-489b-bda0-c9b76ad7f546 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.637226 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.637897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.638187 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.638497 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.639259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.640952 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.652266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1407/2783] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:49.656331 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.666450 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323b2d-1f11-4b05-b5bb-d0748c0e968d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.671202 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4f4a0-98f6-434f-aaa0-c34fc24b5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.671881 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f4a0-98f6-434f-aaa0-c34fc24b5aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.672170 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f4a0-98f6-434f-aaa0-c34fc24b5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.672481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4f4a0-98f6-434f-aaa0-c34fc24b5aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.673242 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4f4a0-98f6-434f-aaa0-c34fc24b5aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.675364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4f4a0-98f6-434f-aaa0-c34fc24b5aa7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.685665 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1377/2784] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:49.690331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.700947 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf7ca4-02ef-4464-bcae-b786bc3e13cf admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.706070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.706975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.707267 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.707549 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] PATH_INFO: `/v3/projects/a8354080861a4af2b8664aeb83493859/users/a08256e8385d40d692243775564c3a77/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.722775 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8354080861a4af2b8664aeb83493859, user_id=a08256e8385d40d692243775564c3a77, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.725750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.738896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1408/2785] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:49 2022] PUT /identity/v3/projects/a8354080861a4af2b8664aeb83493859/users/a08256e8385d40d692243775564c3a77/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:49.750104 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef7ac0-bd49-4f99-a73f-fa58487271cb None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.750399 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef7ac0-bd49-4f99-a73f-fa58487271cb None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.751298 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef7ac0-bd49-4f99-a73f-fa58487271cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.778845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-75ef7ac0-bd49-4f99-a73f-fa58487271cb None None] MFA Rules not processed for user `a08256e8385d40d692243775564c3a77`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:49.780143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-75ef7ac0-bd49-4f99-a73f-fa58487271cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:49.844285 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1378/2786] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:49.849331 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.910135 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977293-7cbf-4ea8-9f17-ba7b59cd3c20 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:49.914811 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:49.915459 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:49.915743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:49.916020 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:49.916741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:49.918623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:49.943614 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1409/2787] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 15:05:49.947768 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef7ac0-bd49-4f99-a73f-fa58487271cb None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:49.958755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef7ac0-bd49-4f99-a73f-fa58487271cb None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:50.015021 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:50.015697 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.015984 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.016901 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:50.017591 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:50.019524 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:50.038970 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1379/2788] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:05:49 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:50.042974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:50.054191 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76b5a0-185d-4590-9150-43db753f74b6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:50.059446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:50.060103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.060387 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.060699 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:50.061456 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:50.063071 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:50.073739 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1410/2789] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:50.078010 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:50.084303 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:50.088355 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c16ff2-4c34-4e05-967d-e7c2eb692aeb admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:50.094194 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:50.095630 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.095863 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.096138 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] PATH_INFO: `/v3/projects/d5ffa1ec48964257a62e568a2a7179f8/users/1174d140ef3b4f138087af20ecd73128/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:50.111226 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ffa1ec48964257a62e568a2a7179f8, user_id=1174d140ef3b4f138087af20ecd73128, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:50.113956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:50.126387 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1380/2790] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:50 2022] PUT /identity/v3/projects/d5ffa1ec48964257a62e568a2a7179f8/users/1174d140ef3b4f138087af20ecd73128/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:50.130309 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:50.140573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da63ee6-6f9b-4bb1-a222-d6b0d386d5bb admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:50.196813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b3bee-40c7-47b6-81a5-66bf3186c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:50.197490 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3bee-40c7-47b6-81a5-66bf3186c08b admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.197782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3bee-40c7-47b6-81a5-66bf3186c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.198063 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3bee-40c7-47b6-81a5-66bf3186c08b admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:50.198788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b3bee-40c7-47b6-81a5-66bf3186c08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:50.200424 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b3bee-40c7-47b6-81a5-66bf3186c08b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:50.210747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1411/2791] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:05:50.216634 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:50.227419 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d847-7aa4-4310-b1e4-89b813a02132 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:50.232093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:50.233022 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.233305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.233578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] PATH_INFO: `/v3/projects/d5ffa1ec48964257a62e568a2a7179f8/users/1174d140ef3b4f138087af20ecd73128/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:50.236108 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ffa1ec48964257a62e568a2a7179f8, user_id=1174d140ef3b4f138087af20ecd73128, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:50.238791 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:50.248880 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1381/2792] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:50 2022] PUT /identity/v3/projects/d5ffa1ec48964257a62e568a2a7179f8/users/1174d140ef3b4f138087af20ecd73128/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:50.259152 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.259528 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.259770 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:50.286469 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] MFA Rules not processed for user `1174d140ef3b4f138087af20ecd73128`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:50.287798 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:50.306944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:50.357607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1412/2793] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:50.369600 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:50.371319 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:50.429841 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074ab5-962b-454f-9e5e-41e06e812670 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:50.433501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:50.434145 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.434433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.434712 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:50.443844 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:50.445332 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:50.455541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1382/2794] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:05:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:05:50.939307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:50.940930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:50.954592 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3be10-646c-41ed-99e1-619553c957d4 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:50.958678 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:50.959353 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:50.959677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:50.959964 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:51.017840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:51.019276 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:51.028286 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1413/2795] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:05:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:05:54.991014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:54.999761 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f68b-3d97-4545-8253-26ed947ed865 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:55.003418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd04f4-0bc5-4d19-80fc-008559337708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:55.004056 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd04f4-0bc5-4d19-80fc-008559337708 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:55.004343 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd04f4-0bc5-4d19-80fc-008559337708 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:55.004656 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd04f4-0bc5-4d19-80fc-008559337708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:55.061027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd04f4-0bc5-4d19-80fc-008559337708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:55.062403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd04f4-0bc5-4d19-80fc-008559337708 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:55.071728 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1383/2796] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:05:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:05:57.116079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:57.181058 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5cb2e-548a-4f1f-ac37-05d508f85c46 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:57.185782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:57.186720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:57.187009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:57.187293 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] PATH_INFO: `/v3/users/60d1206041f54aaf8fe95b378aa866f3` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:57.189108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d1206041f54aaf8fe95b378aa866f3)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:57.191086 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:57.237244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d1206041f54aaf8fe95b378aa866f3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.244110 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d1206041f54aaf8fe95b378aa866f3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.245266 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:57.258055 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d1206041f54aaf8fe95b378aa866f3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.258719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d1206041f54aaf8fe95b378aa866f3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.259322 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d1206041f54aaf8fe95b378aa866f3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.271755 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1414/2797] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:05:57 2022] DELETE /identity/v3/users/60d1206041f54aaf8fe95b378aa866f3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:57.276413 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:57.276936 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:57.277044 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:57.293523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:57.294743 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:57.353414 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1384/2798] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:05:57.362896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:57.364332 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:57.423363 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e516d06-cf07-4a6e-9b31-6080c49ef9f1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:57.427009 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:57.427642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:57.427924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:57.428201 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:57.437345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:57.438829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:57.448382 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1415/2799] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:05:57.719563 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:57.721024 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:57.733974 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e33953-a259-4ea6-9160-a27d709cf7e7 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:57.739159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:57.740032 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:57.740321 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:57.740756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] PATH_INFO: `/v3/projects/ee3429e6b564411fbb54de01733ba1da` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:57.741959 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3429e6b564411fbb54de01733ba1da)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:57.743953 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:57.746865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:57.791172 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3429e6b564411fbb54de01733ba1da', 'request_id': 'req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.798569 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3429e6b564411fbb54de01733ba1da', 'request_id': 'req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.804019 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3429e6b564411fbb54de01733ba1da', 'request_id': 'req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.815511 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] The token cache is being invalidate because project ee3429e6b564411fbb54de01733ba1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:05:57.815824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.816452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.818009 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1385/2800] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:05:57 2022] DELETE /identity/v3/projects/ee3429e6b564411fbb54de01733ba1da => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:57.822059 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:57.831711 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1cb5-e373-4706-a4c7-3468cf67612a service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:57.886514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:57.887379 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:57.887660 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:57.887938 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] PATH_INFO: `/v3/users/a08256e8385d40d692243775564c3a77` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:57.889157 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08256e8385d40d692243775564c3a77)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:57.891720 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:57.936969 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08256e8385d40d692243775564c3a77'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.944359 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08256e8385d40d692243775564c3a77'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.956449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08256e8385d40d692243775564c3a77'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.957252 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08256e8385d40d692243775564c3a77'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.957865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08256e8385d40d692243775564c3a77'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:57.961380 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:57.971492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1416/2801] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:05:57 2022] DELETE /identity/v3/users/a08256e8385d40d692243775564c3a77 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:58.234191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:58.236393 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:58.250156 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbdbf9-7c2f-4172-8eb7-bd613f8ee81e admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:58.307005 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:58.307876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:58.308160 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:58.308438 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] PATH_INFO: `/v3/projects/a8354080861a4af2b8664aeb83493859` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:58.309645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8354080861a4af2b8664aeb83493859)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:58.311551 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:58.356792 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8354080861a4af2b8664aeb83493859', 'request_id': 'req-5aa3a3b9-5b58-403c-84ea-f3f0783926af'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.364445 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8354080861a4af2b8664aeb83493859', 'request_id': 'req-5aa3a3b9-5b58-403c-84ea-f3f0783926af'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.369912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8354080861a4af2b8664aeb83493859', 'request_id': 'req-5aa3a3b9-5b58-403c-84ea-f3f0783926af'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.380730 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] The token cache is being invalidate because project a8354080861a4af2b8664aeb83493859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:05:58.381018 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.381671 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.383186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1386/2802] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:05:58 2022] DELETE /identity/v3/projects/a8354080861a4af2b8664aeb83493859 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:58.387111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:58.388532 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:58.400985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e89ff9-a19e-4ad7-91ce-b76ec14a358b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:58.458145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:58.459018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:58.459299 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:58.459574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] PATH_INFO: `/v3/users/1174d140ef3b4f138087af20ecd73128` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:58.460824 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1174d140ef3b4f138087af20ecd73128)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:58.462738 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:58.511161 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1174d140ef3b4f138087af20ecd73128'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.518758 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1174d140ef3b4f138087af20ecd73128'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.530476 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1174d140ef3b4f138087af20ecd73128'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.531144 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1174d140ef3b4f138087af20ecd73128'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.531737 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-bf82a1f4-e4e8-420e-88d3-1744a37aecab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1174d140ef3b4f138087af20ecd73128'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.543804 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1417/2803] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:05:58 2022] DELETE /identity/v3/users/1174d140ef3b4f138087af20ecd73128 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:58.815429 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:58.816927 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:58.830364 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a3b9-5b58-403c-84ea-f3f0783926af admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:58.850112 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:58.889085 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:58.889988 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:58.890278 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:58.890561 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] PATH_INFO: `/v3/projects/d5ffa1ec48964257a62e568a2a7179f8` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:58.892258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ffa1ec48964257a62e568a2a7179f8)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:58.894255 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:58.939742 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ffa1ec48964257a62e568a2a7179f8', 'request_id': 'req-e4424642-0f04-4451-96c7-42ee89ba5312'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.947118 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ffa1ec48964257a62e568a2a7179f8', 'request_id': 'req-e4424642-0f04-4451-96c7-42ee89ba5312'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.952543 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ffa1ec48964257a62e568a2a7179f8', 'request_id': 'req-e4424642-0f04-4451-96c7-42ee89ba5312'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.964055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] The token cache is being invalidate because project d5ffa1ec48964257a62e568a2a7179f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:05:58.964348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.965014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-e4424642-0f04-4451-96c7-42ee89ba5312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:05:58.966525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1387/2804] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:05:58 2022] DELETE /identity/v3/projects/d5ffa1ec48964257a62e568a2a7179f8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:58.972814 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c99a2-811c-411a-905d-952c8f48169f None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:58.973111 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c99a2-811c-411a-905d-952c8f48169f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:58.973395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c99a2-811c-411a-905d-952c8f48169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:58.991075 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-e87c99a2-811c-411a-905d-952c8f48169f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:58.992208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-e87c99a2-811c-411a-905d-952c8f48169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:59.050803 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1418/2805] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:59.059157 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7466-5eda-44fc-a5c7-916154b4314e None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.059452 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7466-5eda-44fc-a5c7-916154b4314e None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.059736 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe7466-5eda-44fc-a5c7-916154b4314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.077925 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-afbe7466-5eda-44fc-a5c7-916154b4314e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:59.079192 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-afbe7466-5eda-44fc-a5c7-916154b4314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:59.087195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1388/2806] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:59.091287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c99a2-811c-411a-905d-952c8f48169f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.101397 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c99a2-811c-411a-905d-952c8f48169f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.105974 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.106641 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.106914 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.107202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.107932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:05:59.108244 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.110512 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.121936 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1419/2807] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:05:59.126086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe7466-5eda-44fc-a5c7-916154b4314e None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.135609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe7466-5eda-44fc-a5c7-916154b4314e None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.140307 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.140994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.141284 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.141567 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.142265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.144175 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.168976 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1389/2808] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:05:59 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:59.173302 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.178450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:59.184944 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505b07-1b8e-48bc-a392-01df7d8e36a6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.242403 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.242992 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.243279 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.243561 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.244262 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.246216 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.265730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1420/2809] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:05:59 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:59.269952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.280222 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eb6d5-d2eb-4d14-902f-398a5ac20c21 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.285615 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.286286 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.286577 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.286862 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.287616 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.289287 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.299907 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1390/2810] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:59.303566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.314117 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec010-e5cb-4dc3-ae20-66da60e7ed28 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.318781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600f865-b184-41ee-8b91-2d1db1e2878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.319430 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600f865-b184-41ee-8b91-2d1db1e2878f admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.319717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600f865-b184-41ee-8b91-2d1db1e2878f admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.319996 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600f865-b184-41ee-8b91-2d1db1e2878f admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.320808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600f865-b184-41ee-8b91-2d1db1e2878f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.322500 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600f865-b184-41ee-8b91-2d1db1e2878f admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.333674 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1421/2811] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:59.338051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.348048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980fbb9-06b1-497b-a41b-f27a63706908 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.352738 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.353621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.353910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.354195 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] PATH_INFO: `/v3/projects/3d16c7c4916d4d0fa88cb75dad6f20e1/users/37245922b6684415bc9e9d3206c26469/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.368603 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d16c7c4916d4d0fa88cb75dad6f20e1, user_id=37245922b6684415bc9e9d3206c26469, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.371262 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.384103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1391/2812] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:59 2022] PUT /identity/v3/projects/3d16c7c4916d4d0fa88cb75dad6f20e1/users/37245922b6684415bc9e9d3206c26469/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:05:59.396671 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5520-dcba-43e0-a30b-e350a907788e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.397183 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5520-dcba-43e0-a30b-e350a907788e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.397284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5520-dcba-43e0-a30b-e350a907788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.425480 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ca5e5520-dcba-43e0-a30b-e350a907788e None None] MFA Rules not processed for user `37245922b6684415bc9e9d3206c26469`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:59.426681 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ca5e5520-dcba-43e0-a30b-e350a907788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:05:59.490083 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1422/2813] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:05:59.494851 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.546583 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:59.561964 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a692e-a626-4806-bdfd-2b4691bba988 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.567325 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.567981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.568295 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.568548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.569264 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.571204 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.595476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1392/2814] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:05:59 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:59.599623 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e5520-dcba-43e0-a30b-e350a907788e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.611006 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e5520-dcba-43e0-a30b-e350a907788e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.666781 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.667447 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.667733 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.668012 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.668759 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.670664 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.687533 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:05:59.697269 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1423/2815] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:05:59 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:05:59.698428 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.708696 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566fe14-e292-4495-a82a-79d04578a72d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.713345 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.714006 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.714294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.714572 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.715294 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.717111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.728501 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1393/2816] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:59.732743 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.745251 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dc883-2399-40e9-93af-9990887f94f2 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.749788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.750713 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.750993 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.751771 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] PATH_INFO: `/v3/projects/a9283665dc3f41199f2b2796a2bc57da/users/5454fd228f604e9faa15417307971bbf/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.766148 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9283665dc3f41199f2b2796a2bc57da, user_id=5454fd228f604e9faa15417307971bbf, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.768828 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.782880 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1424/2817] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:59 2022] PUT /identity/v3/projects/a9283665dc3f41199f2b2796a2bc57da/users/5454fd228f604e9faa15417307971bbf/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:05:59.786755 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.797677 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23510fa2-aa04-4bca-91aa-a0d913f7bbdf admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.853834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa465de3-95f3-4c10-b75f-0a74c74e7474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.854503 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465de3-95f3-4c10-b75f-0a74c74e7474 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.854786 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465de3-95f3-4c10-b75f-0a74c74e7474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.855063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa465de3-95f3-4c10-b75f-0a74c74e7474 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.855779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa465de3-95f3-4c10-b75f-0a74c74e7474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.857400 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa465de3-95f3-4c10-b75f-0a74c74e7474 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.867588 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1394/2818] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:05:59.871728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:05:59.881726 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e48973-779b-44fd-bdcd-f29a09bb1dab admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:05:59.886292 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:05:59.887162 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.887442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.887717 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] PATH_INFO: `/v3/projects/a9283665dc3f41199f2b2796a2bc57da/users/5454fd228f604e9faa15417307971bbf/roles/d8afc9e2524f423584e6c7f3247e456e` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.889668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9283665dc3f41199f2b2796a2bc57da, user_id=5454fd228f604e9faa15417307971bbf, role_id=d8afc9e2524f423584e6c7f3247e456e)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:05:59.892307 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:05:59.902740 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1425/2819] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:05:59 2022] PUT /identity/v3/projects/a9283665dc3f41199f2b2796a2bc57da/users/5454fd228f604e9faa15417307971bbf/roles/d8afc9e2524f423584e6c7f3247e456e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:05:59.913023 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:05:59.913323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:05:59.913610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:05:59.940418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] MFA Rules not processed for user `5454fd228f604e9faa15417307971bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:05:59.941680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:00.009304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1395/2820] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:00.019961 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:00.021687 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:00.078220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338dca-8af6-4f9a-ac67-68db66cc2038 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:00.081847 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:00.082537 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:00.082826 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:00.083134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:00.091982 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:00.093448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:00.103200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1426/2821] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:00.149994 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:00.151536 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:00.170097 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ad0f8-2e40-4f2a-b715-675f2d6b12aa None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:00.174113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cbdd7-e03d-492c-a91f-7cbd609f9371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:00.174763 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cbdd7-e03d-492c-a91f-7cbd609f9371 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:00.175060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cbdd7-e03d-492c-a91f-7cbd609f9371 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:00.175368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cbdd7-e03d-492c-a91f-7cbd609f9371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:00.226086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:00.241832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cbdd7-e03d-492c-a91f-7cbd609f9371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:00.243288 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cbdd7-e03d-492c-a91f-7cbd609f9371 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:00.252090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1396/2822] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:06:03.483095 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:03.544866 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26af0d-aba2-4f6f-a12a-2a519e97eb70 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:03.549510 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:03.550370 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:03.550651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:03.550930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] PATH_INFO: `/v3/users/37245922b6684415bc9e9d3206c26469` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:03.552101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37245922b6684415bc9e9d3206c26469)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:03.554047 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:03.600800 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37245922b6684415bc9e9d3206c26469'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:03.607782 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37245922b6684415bc9e9d3206c26469'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:03.616335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:03.622089 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37245922b6684415bc9e9d3206c26469'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:03.623008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37245922b6684415bc9e9d3206c26469'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:03.623715 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37245922b6684415bc9e9d3206c26469'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:03.637470 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1427/2823] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:06:03 2022] DELETE /identity/v3/users/37245922b6684415bc9e9d3206c26469 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:06:03.642100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:03.642613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:03.642714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:03.660041 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:06:03.661262 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:03.719368 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1397/2824] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:03.729016 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:03.730513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:03.789893 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae4d3-b287-4d5a-88b2-62c7d00b38d1 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:03.793633 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:03.794301 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:03.794573 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:03.794854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:03.804976 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:03.806444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:03.816433 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1428/2825] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:06:04.078919 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:04.080471 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:04.097719 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa743c-1ad3-4e06-abe4-e7b387584a4a None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:04.102528 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:04.103467 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:04.103589 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:04.103874 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] PATH_INFO: `/v3/projects/3d16c7c4916d4d0fa88cb75dad6f20e1` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:04.105055 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d16c7c4916d4d0fa88cb75dad6f20e1)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:04.106958 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:04.154297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d16c7c4916d4d0fa88cb75dad6f20e1', 'request_id': 'req-2739a36b-e9b4-4aec-a258-50b9134aef0f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.161575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d16c7c4916d4d0fa88cb75dad6f20e1', 'request_id': 'req-2739a36b-e9b4-4aec-a258-50b9134aef0f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.167171 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d16c7c4916d4d0fa88cb75dad6f20e1', 'request_id': 'req-2739a36b-e9b4-4aec-a258-50b9134aef0f'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.178681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] The token cache is being invalidate because project 3d16c7c4916d4d0fa88cb75dad6f20e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:06:04.178967 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.179849 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.181460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1398/2826] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:06:04 2022] DELETE /identity/v3/projects/3d16c7c4916d4d0fa88cb75dad6f20e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:06:04.185355 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:04.195471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d199723-0c90-4fb8-8a6f-dda1e6dcceb0 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:04.254092 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:04.254971 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:04.255272 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:04.255539 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] PATH_INFO: `/v3/users/5454fd228f604e9faa15417307971bbf` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:04.256810 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5454fd228f604e9faa15417307971bbf)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:04.258725 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:04.304258 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5454fd228f604e9faa15417307971bbf'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.311615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5454fd228f604e9faa15417307971bbf'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.323473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5454fd228f604e9faa15417307971bbf'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.324168 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5454fd228f604e9faa15417307971bbf'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.324830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-21386530-383c-4128-83a7-91fb600bcc96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5454fd228f604e9faa15417307971bbf'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.337450 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1429/2827] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:06:04 2022] DELETE /identity/v3/users/5454fd228f604e9faa15417307971bbf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:06:04.605140 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:04.606575 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:04.619688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739a36b-e9b4-4aec-a258-50b9134aef0f admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:04.679741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:04.680718 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:04.680956 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:04.681243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] PATH_INFO: `/v3/projects/a9283665dc3f41199f2b2796a2bc57da` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:04.682430 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9283665dc3f41199f2b2796a2bc57da)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:04.684348 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:04.692832 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:04.731861 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9283665dc3f41199f2b2796a2bc57da', 'request_id': 'req-5925047c-242b-4126-8346-c6bbaf0e2286'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.739312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9283665dc3f41199f2b2796a2bc57da', 'request_id': 'req-5925047c-242b-4126-8346-c6bbaf0e2286'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.744802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9283665dc3f41199f2b2796a2bc57da', 'request_id': 'req-5925047c-242b-4126-8346-c6bbaf0e2286'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.755542 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] The token cache is being invalidate because project a9283665dc3f41199f2b2796a2bc57da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:06:04.755834 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.756465 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-5925047c-242b-4126-8346-c6bbaf0e2286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:06:04.758051 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1399/2828] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:06:04 2022] DELETE /identity/v3/projects/a9283665dc3f41199f2b2796a2bc57da => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:06:04.763070 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63027b-6ad6-42f2-aadf-1b08733b4ce1 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:04.763552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63027b-6ad6-42f2-aadf-1b08733b4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:04.763757 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63027b-6ad6-42f2-aadf-1b08733b4ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:04.776650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:04.783911 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-cd63027b-6ad6-42f2-aadf-1b08733b4ce1 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:06:04.785823 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-cd63027b-6ad6-42f2-aadf-1b08733b4ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:04.844522 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1430/2829] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:04.853421 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eab03-786f-44ee-a198-ac0aca0fcd22 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:04.853715 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eab03-786f-44ee-a198-ac0aca0fcd22 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:04.853997 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eab03-786f-44ee-a198-ac0aca0fcd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:04.871876 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-916eab03-786f-44ee-a198-ac0aca0fcd22 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:06:04.873084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-916eab03-786f-44ee-a198-ac0aca0fcd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:04.880972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1400/2830] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:04.885137 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63027b-6ad6-42f2-aadf-1b08733b4ce1 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:04.895354 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63027b-6ad6-42f2-aadf-1b08733b4ce1 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:04.900172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:04.900879 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:04.901186 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:04.901473 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:04.902228 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:06:04.902559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:04.904193 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:04.916432 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1431/2831] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:06:04.920480 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eab03-786f-44ee-a198-ac0aca0fcd22 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:04.929747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eab03-786f-44ee-a198-ac0aca0fcd22 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:04.934418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:04.934996 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:04.935275 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:04.935550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:04.936237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:04.938416 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:04.963340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1401/2832] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:06:04 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:06:04.967400 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:04.977404 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4244db9-7d94-4ecc-af68-c60eb1e1c080 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:05.033827 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:05.034491 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:05.034930 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:05.035221 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:05.035915 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:05.037867 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:05.057707 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1432/2833] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:06:04 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:06:05.061724 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:05.072990 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc2d15-eaa1-49f6-8a57-a1d44ee0ab8d admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:05.077805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:05.078476 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:05.078764 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:05.079048 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:05.079772 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:05.081443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:05.092103 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1402/2834] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:06:05.096254 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:05.106143 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d74a7-8fbb-4322-9e61-58ba7db5c469 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:05.111509 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031985-606e-4606-aa5a-c6867de5e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:05.112154 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031985-606e-4606-aa5a-c6867de5e3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:05.112445 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031985-606e-4606-aa5a-c6867de5e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:05.112813 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031985-606e-4606-aa5a-c6867de5e3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:05.113550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031985-606e-4606-aa5a-c6867de5e3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:05.115127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031985-606e-4606-aa5a-c6867de5e3b4 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:05.125466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1433/2835] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:06:05.129483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:05.140131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4653e16-fa54-4251-857c-78939e50ffc7 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:05.145361 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:05.146243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:05.146529 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:05.146810 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] PATH_INFO: `/v3/projects/00895e40e4484304937344779ff6f048/users/b1fcf616a6f543a9898c3ed755131d03/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:05.161025 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00895e40e4484304937344779ff6f048, user_id=b1fcf616a6f543a9898c3ed755131d03, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:05.163798 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:05.176217 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1403/2836] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:06:05 2022] PUT /identity/v3/projects/00895e40e4484304937344779ff6f048/users/b1fcf616a6f543a9898c3ed755131d03/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:06:05.181412 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354212b-b8dd-4a76-94fd-a59148dd10ef None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:05.181741 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354212b-b8dd-4a76-94fd-a59148dd10ef None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:05.182033 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354212b-b8dd-4a76-94fd-a59148dd10ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:05.200312 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-b354212b-b8dd-4a76-94fd-a59148dd10ef None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:06:05.201545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-b354212b-b8dd-4a76-94fd-a59148dd10ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:05.260179 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1434/2837] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:05.321739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:05.323500 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:05.382183 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380053c-8bc2-4e21-8f35-528156dd1966 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:05.386889 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:05.387541 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:05.387831 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:05.388114 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:05.397704 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:05.399149 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:05.408666 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1404/2838] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:06.017220 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f3ea-7a0c-4669-8a44-a3c257fdd181 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:06.017747 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f3ea-7a0c-4669-8a44-a3c257fdd181 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:06.017849 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f3ea-7a0c-4669-8a44-a3c257fdd181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:06.041940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:06.044912 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-87b1f3ea-7a0c-4669-8a44-a3c257fdd181 None None] MFA Rules not processed for user `b1fcf616a6f543a9898c3ed755131d03`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:06:06.047496 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-87b1f3ea-7a0c-4669-8a44-a3c257fdd181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:06.117038 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1435/2839] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:06.127747 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:06.129230 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:06.170408 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:06.191162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3379e65-6a07-4693-b106-0eab1550ac96 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:06.195080 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:06.195865 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:06.196237 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:06.196597 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:06.206159 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:06.207613 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:06.216609 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1405/2840] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:07.558975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae947a59-c930-4ac9-8fa7-2e0336e284cf None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:07.559458 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae947a59-c930-4ac9-8fa7-2e0336e284cf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:07.559556 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae947a59-c930-4ac9-8fa7-2e0336e284cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:07.578145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-ae947a59-c930-4ac9-8fa7-2e0336e284cf None None] MFA Rules not processed for user `b1fcf616a6f543a9898c3ed755131d03`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:06:07.579345 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ae947a59-c930-4ac9-8fa7-2e0336e284cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:07.586318 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1436/2841] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:07.625648 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:07.627100 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:07.686512 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88dd6-426e-4e66-882b-172b3f257fbe service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:07.690824 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '420ae644ec5548fbbde64ffa63c868ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:07.691468 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:07.691789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:07.692073 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:07.693980 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:07.768098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:07.769496 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:07.780291 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1406/2842] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:07.980617 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae947a59-c930-4ac9-8fa7-2e0336e284cf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:07.990349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae947a59-c930-4ac9-8fa7-2e0336e284cf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:07.993999 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:07.994640 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:07.994924 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:07.995200 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:07.997004 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:08.006908 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:08.008315 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:08.017065 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1437/2843] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:08.357057 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:08.358594 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:08.378245 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:08.387335 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fd088-0264-453f-b8b6-96a20ca48413 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:08.391650 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:08.392364 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:08.392776 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:08.393066 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:08.394871 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:08.410423 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:08.411906 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:08.423150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1438/2844] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:06:08.434636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc13eb-ab34-41a9-b09b-147162e60fe4 service glance] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:08.439829 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:08.440555 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:08.440878 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:08.441166 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:08.443049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:08.456895 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:08.458545 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:08.475912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1407/2845] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:12.184835 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:12.194145 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04ba52-1cc3-446f-954e-2d41cf7e9278 service neutron] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:12.197913 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d978e-4408-4306-8704-7d1a30c635f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:12.198552 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d978e-4408-4306-8704-7d1a30c635f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:12.198897 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d978e-4408-4306-8704-7d1a30c635f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:12.199180 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d978e-4408-4306-8704-7d1a30c635f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:12.201093 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-115d978e-4408-4306-8704-7d1a30c635f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:12.211294 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d978e-4408-4306-8704-7d1a30c635f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:12.212841 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d978e-4408-4306-8704-7d1a30c635f2 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:12.221567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1439/2846] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:12.883098 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:12.887389 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:12.905987 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c49e70-f7a4-4d7d-8cfd-e2d1b735fd36 service placement] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:12.912944 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:12.913632 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:12.913962 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:12.914244 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:12.916305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:12.927443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=100 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:12.932963 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:12.934621 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:12.946916 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1408/2847] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:16.083808 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611130-13b6-4454-b287-cc16d7578852 None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:16.084342 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611130-13b6-4454-b287-cc16d7578852 None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:16.084709 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611130-13b6-4454-b287-cc16d7578852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:16.103139 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-86611130-13b6-4454-b287-cc16d7578852 None None] MFA Rules not processed for user `b1a4f9ee8de446fe989b4d91ea0315e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:06:16.104422 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-86611130-13b6-4454-b287-cc16d7578852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:16.163795 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1440/2848] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:06:16.498372 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:16.507776 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a685-1b10-486c-b550-ff66edbf094b service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:16.511448 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:16.512084 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:16.512365 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:16.512663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:16.514474 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:16.523855 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:16.525318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:16.533932 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1409/2849] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:18.294155 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86611130-13b6-4454-b287-cc16d7578852 None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:18.314677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86611130-13b6-4454-b287-cc16d7578852 None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:18.326932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d401c9-b773-427e-96df-b3d33cbdd296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:18.327766 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d401c9-b773-427e-96df-b3d33cbdd296 service nova] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:18.328062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d401c9-b773-427e-96df-b3d33cbdd296 service nova] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:18.328351 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d401c9-b773-427e-96df-b3d33cbdd296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:18.331101 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-75d401c9-b773-427e-96df-b3d33cbdd296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:18.350008 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d401c9-b773-427e-96df-b3d33cbdd296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:18.351881 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d401c9-b773-427e-96df-b3d33cbdd296 service nova] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:18.365780 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1441/2850] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:26.529556 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=8 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:28.360383 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=78 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:06:36.637067 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:06:36.638525 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:36.654177 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11d22d-92e6-40bf-ba5d-505da5248ddd service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:06:36.661007 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06274e1b42f6471cac81889ec673a222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:06:36.661680 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:06:36.661965 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:06:36.662431 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:06:36.664324 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:06:36.677709 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:06:36.679301 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:06:36.690443 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1410/2851] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:06:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:06:46.685870 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=6 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:07:13.693210 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938ade-b198-4bd4-ba55-d3c4834f848a None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:07:13.693750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938ade-b198-4bd4-ba55-d3c4834f848a None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:07:13.693750 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938ade-b198-4bd4-ba55-d3c4834f848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:07:13.710806 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-c4938ade-b198-4bd4-ba55-d3c4834f848a None None] MFA Rules not processed for user `b1fcf616a6f543a9898c3ed755131d03`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:07:13.712021 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-c4938ade-b198-4bd4-ba55-d3c4834f848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:07:13.719625 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1442/2852] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:07:23.705684 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:12.102564 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:12.162093 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ca2ef-1390-4294-8884-e110ecd39f63 service nova] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:12.167050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:12.168495 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:12.168808 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:12.169086 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] PATH_INFO: `/v3/users/b1fcf616a6f543a9898c3ed755131d03` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:12.170258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fcf616a6f543a9898c3ed755131d03)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:12.172225 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:12.219883 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fcf616a6f543a9898c3ed755131d03'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.220533 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fcf616a6f543a9898c3ed755131d03'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.232887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fcf616a6f543a9898c3ed755131d03'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.239706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fcf616a6f543a9898c3ed755131d03'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.240342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-a5c56440-1545-4491-b24a-4a7f36238817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fcf616a6f543a9898c3ed755131d03'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.255164 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1411/2853] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:08:12 2022] DELETE /identity/v3/users/b1fcf616a6f543a9898c3ed755131d03 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:12.431712 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938ade-b198-4bd4-ba55-d3c4834f848a None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:12.467899 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938ade-b198-4bd4-ba55-d3c4834f848a None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:12.524492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:12.525395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:12.525683 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:12.525962 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] PATH_INFO: `/v3/projects/00895e40e4484304937344779ff6f048` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:12.527675 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00895e40e4484304937344779ff6f048)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:12.529616 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:12.576119 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00895e40e4484304937344779ff6f048', 'request_id': 'req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.581756 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00895e40e4484304937344779ff6f048', 'request_id': 'req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.591734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00895e40e4484304937344779ff6f048', 'request_id': 'req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.615728 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] The token cache is being invalidate because project 00895e40e4484304937344779ff6f048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:08:12.615945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.616622 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-235b5ec5-6a78-4e38-ba9e-b8ad0283bb4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:12.618181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1443/2854] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:08:12 2022] DELETE /identity/v3/projects/00895e40e4484304937344779ff6f048 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:12.624745 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324226b-d998-4fd3-9fa7-481d628bf2bf None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:12.625304 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324226b-d998-4fd3-9fa7-481d628bf2bf None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:12.625819 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324226b-d998-4fd3-9fa7-481d628bf2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:12.688898 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-5324226b-d998-4fd3-9fa7-481d628bf2bf None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:12.690141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5324226b-d998-4fd3-9fa7-481d628bf2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:12.752941 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1412/2855] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:08:12.761840 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640960-7b59-432b-8366-4730144f8f8e None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:12.762130 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640960-7b59-432b-8366-4730144f8f8e None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:12.762446 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640960-7b59-432b-8366-4730144f8f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:12.780479 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-71640960-7b59-432b-8366-4730144f8f8e None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:12.781718 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-71640960-7b59-432b-8366-4730144f8f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:12.789815 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1444/2856] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:08:12.794731 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324226b-d998-4fd3-9fa7-481d628bf2bf None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:12.799741 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:12.807977 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324226b-d998-4fd3-9fa7-481d628bf2bf None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:12.814094 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:12.814760 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:12.815049 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:12.815334 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:12.816061 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:08:12.816379 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:12.818161 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:12.830090 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1413/2857] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:08:12.834483 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71640960-7b59-432b-8366-4730144f8f8e None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:12.844398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71640960-7b59-432b-8366-4730144f8f8e None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:12.849197 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:12.849846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:12.850133 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:12.850415 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:12.851134 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:12.853107 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:12.880208 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1445/2858] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:08:12 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:08:12.884311 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:12.894684 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ea719-1487-4718-981c-2293b8f760e5 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:12.951318 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:12.951991 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:12.952277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:12.952558 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] PATH_INFO: `/v3/users` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:12.953274 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:12.955209 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:12.978807 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1414/2859] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:08:12 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:08:12.982998 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:12.997287 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527647-9f39-47e1-a2dc-3a04562b42cd admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:13.004418 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:13.005120 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:13.005412 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:13.005696 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:13.006429 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:13.008050 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:13.019007 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1446/2860] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:08:13.022805 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:13.033455 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b6726-6542-4dac-9de5-321c9fc7bb20 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:13.038125 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d0409-d9a1-40e5-939f-239b9732cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:13.038784 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0409-d9a1-40e5-939f-239b9732cad6 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:13.039074 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0409-d9a1-40e5-939f-239b9732cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:13.039358 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0409-d9a1-40e5-939f-239b9732cad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:13.040087 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d0409-d9a1-40e5-939f-239b9732cad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:13.041725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d0409-d9a1-40e5-939f-239b9732cad6 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:13.052893 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1415/2861] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:08:13.057049 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:13.068017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06f34-208e-4ec9-ab69-5d9df2e14a24 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:13.072670 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:13.073575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:13.073864 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:13.074150 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] PATH_INFO: `/v3/projects/ee9248865ec042f29535291894c72343/users/836e9550272b44f68f5f06c15a55b1b3/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:13.089018 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9248865ec042f29535291894c72343, user_id=836e9550272b44f68f5f06c15a55b1b3, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:13.091708 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:13.099502 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:13.107218 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1447/2862] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:08:13 2022] PUT /identity/v3/projects/ee9248865ec042f29535291894c72343/users/836e9550272b44f68f5f06c15a55b1b3/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:13.117174 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:13.117645 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:13.117756 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:13.146063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] MFA Rules not processed for user `836e9550272b44f68f5f06c15a55b1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:13.147219 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:13.211089 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1416/2863] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:08:13.225863 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:13.227567 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:13.304090 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff5a3a-9d5b-4a4f-9983-be8c749b1d2b admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:13.307949 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:13.308615 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:13.308896 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:13.309174 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:13.317732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:13.319166 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:13.327900 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1448/2864] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:08:15.953424 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:15.954840 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:16.017191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:16.033578 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154da0-6bfb-4fdd-a915-90b668ced88d None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:16.037224 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079816b8-711d-498a-93a7-214c0b5f1859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:16.037873 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079816b8-711d-498a-93a7-214c0b5f1859 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:16.038162 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079816b8-711d-498a-93a7-214c0b5f1859 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:16.038444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079816b8-711d-498a-93a7-214c0b5f1859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:16.040212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-079816b8-711d-498a-93a7-214c0b5f1859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:16.098277 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079816b8-711d-498a-93a7-214c0b5f1859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:16.099685 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079816b8-711d-498a-93a7-214c0b5f1859 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:16.109297 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1417/2865] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:08:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:08:23.324001 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=34 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:26.104508 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=31 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:32.580319 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:32.643247 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b417-3fbd-4d8e-8320-65808babf309 service cinder] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:32.647829 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:32.648730 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:32.649015 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:32.649295 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] PATH_INFO: `/v3/users/836e9550272b44f68f5f06c15a55b1b3` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:32.650481 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=836e9550272b44f68f5f06c15a55b1b3)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:32.653087 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:32.699317 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836e9550272b44f68f5f06c15a55b1b3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:32.706078 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836e9550272b44f68f5f06c15a55b1b3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:32.718300 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836e9550272b44f68f5f06c15a55b1b3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:32.718965 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836e9550272b44f68f5f06c15a55b1b3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:32.719574 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836e9550272b44f68f5f06c15a55b1b3'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:32.731395 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1449/2866] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:08:32 2022] DELETE /identity/v3/users/836e9550272b44f68f5f06c15a55b1b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:32.735847 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:32.736314 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:32.736420 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:32.753453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:32.754626 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:32.812523 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1418/2867] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:08:32.822514 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:32.824857 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:32.883890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99fe3-8608-4d7b-bfd4-bbe351efdfd6 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:32.888306 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b66bc-bda0-4d23-a23a-20def3bc7fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:32.888975 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b66bc-bda0-4d23-a23a-20def3bc7fcb service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:32.889264 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b66bc-bda0-4d23-a23a-20def3bc7fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:32.889545 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b66bc-bda0-4d23-a23a-20def3bc7fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:32.898515 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b66bc-bda0-4d23-a23a-20def3bc7fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:32.899940 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b66bc-bda0-4d23-a23a-20def3bc7fcb service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:32.909855 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1450/2868] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:08:33.292550 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.294039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:33.306483 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facff8e2-28c1-42c7-89ce-6457417edd01 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:33.311618 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:33.312481 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.312799 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.313131 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] PATH_INFO: `/v3/projects/ee9248865ec042f29535291894c72343` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.314305 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9248865ec042f29535291894c72343)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:33.316403 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:33.371063 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9248865ec042f29535291894c72343', 'request_id': 'req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:33.379126 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9248865ec042f29535291894c72343', 'request_id': 'req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:33.385426 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9248865ec042f29535291894c72343', 'request_id': 'req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:33.400401 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] The token cache is being invalidate because project ee9248865ec042f29535291894c72343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:08:33.400789 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:33.401460 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-f48ac3c2-1e60-4d02-a435-08a2d0995bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:33.403265 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1419/2869] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:08:33 2022] DELETE /identity/v3/projects/ee9248865ec042f29535291894c72343 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:33.407861 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cca13-1382-4246-83ca-5a64e9b777ac None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.408184 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cca13-1382-4246-83ca-5a64e9b777ac None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.408471 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cca13-1382-4246-83ca-5a64e9b777ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.444284 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-3d8cca13-1382-4246-83ca-5a64e9b777ac None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:33.445562 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-3d8cca13-1382-4246-83ca-5a64e9b777ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:33.454830 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:33.509407 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1451/2870] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 15:08:33.519338 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cad5fa-94d7-408e-9d70-fc5af287b149 None None] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.519845 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cad5fa-94d7-408e-9d70-fc5af287b149 None None] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.520143 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cad5fa-94d7-408e-9d70-fc5af287b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.538814 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.auth.core [None req-c2cad5fa-94d7-408e-9d70-fc5af287b149 None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:33.540035 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-c2cad5fa-94d7-408e-9d70-fc5af287b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:33.551197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1420/2871] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:08:33.555642 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cca13-1382-4246-83ca-5a64e9b777ac None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.565559 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cca13-1382-4246-83ca-5a64e9b777ac None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:33.570877 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:33.571550 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.571832 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.572112 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] PATH_INFO: `/v3/domains` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.572910 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 15:08:33.573224 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:33.574854 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:33.590920 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1452/2872] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 18 15:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 15:08:33.592099 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cad5fa-94d7-408e-9d70-fc5af287b149 None None] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.602323 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cad5fa-94d7-408e-9d70-fc5af287b149 None None] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:33.607899 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:33.608636 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] REQUEST_METHOD: `POST` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.608930 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.609212 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] PATH_INFO: `/v3/projects` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.609912 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:33.611846 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:33.644418 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1421/2873] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 18 15:08:33 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:08:33.648435 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.662575 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490bfbc-deb7-452a-9b06-a845d74b8364 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:33.720697 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:33.721434 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.721724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.722081 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] PATH_INFO: `/v3/users` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.722792 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:33.724856 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:33.748878 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1453/2874] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 18 15:08:33 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 15:08:33.750258 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.760981 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c9bd7-cb48-4804-b243-d3d3359fd28b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:33.765664 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:33.766326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.766610 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.766887 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.767801 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:33.769449 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:33.781725 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1422/2875] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 15:08:33.785945 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.797046 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cddb63-1945-4992-9c30-460a47284145 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:33.802017 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e9646-4e94-4d29-90e1-75c95c752208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:33.802788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9646-4e94-4d29-90e1-75c95c752208 admin admin] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.803103 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9646-4e94-4d29-90e1-75c95c752208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.803388 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9646-4e94-4d29-90e1-75c95c752208 admin admin] PATH_INFO: `/v3/roles` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.804127 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e9646-4e94-4d29-90e1-75c95c752208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:33.806084 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e9646-4e94-4d29-90e1-75c95c752208 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:33.817106 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1454/2876] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 18 15:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 15:08:33.820317 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.830312 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13774e6e-6b09-4a27-ade5-8018184d5d79 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:33.834928 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:33.835809 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.836095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.836378 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] PATH_INFO: `/v3/projects/3364e38dc6734c8d950bb654a1e4084b/users/57752e49733847c99820f2dfad9df096/roles/c906bb6cd0b942fb94f3f843cb8094e5` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.851095 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3364e38dc6734c8d950bb654a1e4084b, user_id=57752e49733847c99820f2dfad9df096, role_id=c906bb6cd0b942fb94f3f843cb8094e5)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:33.853794 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:33.867434 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1423/2877] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 18 15:08:33 2022] PUT /identity/v3/projects/3364e38dc6734c8d950bb654a1e4084b/users/57752e49733847c99820f2dfad9df096/roles/c906bb6cd0b942fb94f3f843cb8094e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:08:33.877677 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:33.877972 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:33.878273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:33.904958 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] MFA Rules not processed for user `57752e49733847c99820f2dfad9df096`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:33.906172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:33.970291 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1455/2878] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:08:33.982243 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:33.984153 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:34.008139 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:34.067185 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad62c7-0c84-41f8-9391-f1362c13ed37 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:34.071060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2524791e2943c2a1eeae24e17c4f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:34.071774 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:34.072060 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:34.072342 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:34.081584 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:34.083027 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:34.092257 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1424/2879] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:08:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:08:35.039698 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:35.041261 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:35.053494 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:35.103542 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a6568-bd4d-4e34-99ba-3a5f490f2ddf None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:35.107136 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfc071-ebed-4543-acb9-05952eea13a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:35.107779 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfc071-ebed-4543-acb9-05952eea13a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:35.108068 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfc071-ebed-4543-acb9-05952eea13a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:35.108349 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfc071-ebed-4543-acb9-05952eea13a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:35.110181 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-7ecfc071-ebed-4543-acb9-05952eea13a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:35.172518 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfc071-ebed-4543-acb9-05952eea13a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:35.173979 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfc071-ebed-4543-acb9-05952eea13a0 service neutron] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:35.184189 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1456/2880] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:08:41.142488 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:41.166886 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea993d-5b15-43fa-8544-1663988e5ee6 service cinder] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:41.173711 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:41.175690 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:41.176141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:41.176688 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] PATH_INFO: `/v3/users/57752e49733847c99820f2dfad9df096` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:41.178115 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57752e49733847c99820f2dfad9df096)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:41.181168 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:41.237818 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57752e49733847c99820f2dfad9df096'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.238714 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57752e49733847c99820f2dfad9df096'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.254779 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57752e49733847c99820f2dfad9df096'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.263716 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57752e49733847c99820f2dfad9df096'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.264739 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57752e49733847c99820f2dfad9df096'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.284947 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1425/2881] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:08:41 2022] DELETE /identity/v3/users/57752e49733847c99820f2dfad9df096 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:41.286651 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] REQUEST_METHOD: `POST` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:41.287129 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:41.287253 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:41.308172 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.auth.core [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] MFA Rules not processed for user `6bb17e1228d44efb843bda521c27b495`. Rule list: `[]` (Enabled: `True`). {{(pid=86727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 15:08:41.309492 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:41.379466 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1457/2882] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 18 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 15:08:41.393033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:41.394548 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:41.470107 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86462b-1c69-4a5b-973b-0bf0d900779b admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:41.474033 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa975bb70624500aa802e7a708014c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:41.475892 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:41.476191 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:41.476478 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:41.502502 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:41.504123 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:41.528678 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1426/2883] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 15:08:41.583118 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:41.585243 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:41.610953 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86290f-8da5-4b49-9ce8-cd25cacda56f None None] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:41.617113 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:41.618443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:41.619202 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:41.620040 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] PATH_INFO: `/v3/users/b1a4f9ee8de446fe989b4d91ea0315e8` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:41.621493 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a4f9ee8de446fe989b4d91ea0315e8)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:41.623612 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:41.677648 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a4f9ee8de446fe989b4d91ea0315e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.689788 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:41.694834 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a4f9ee8de446fe989b4d91ea0315e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.709590 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a4f9ee8de446fe989b4d91ea0315e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.710390 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a4f9ee8de446fe989b4d91ea0315e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.711036 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a4f9ee8de446fe989b4d91ea0315e8'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.725175 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1458/2884] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:08:41 2022] DELETE /identity/v3/users/b1a4f9ee8de446fe989b4d91ea0315e8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:41.822141 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:41.824000 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:41.838802 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e584205-715c-4e38-8682-6c34ec8c7064 service neutron] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:41.853039 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:41.905915 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:41.906822 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:41.907233 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:41.907517 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] PATH_INFO: `/v3/projects/3364e38dc6734c8d950bb654a1e4084b` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:41.909014 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3364e38dc6734c8d950bb654a1e4084b)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:41.910449 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:41.912045 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:41.912729 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:41.945074 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c9008-8065-4dc6-9ada-2c8998860854 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:41.950513 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:41.951448 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:41.951745 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:41.952062 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] PATH_INFO: `/v3/projects/d2f3dc5d9c6648c79267f71b5a86f249` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:41.953523 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f3dc5d9c6648c79267f71b5a86f249)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:41.955749 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:41.963952 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3364e38dc6734c8d950bb654a1e4084b', 'request_id': 'req-9a80bbf8-f5be-4740-a16b-a572271ea8ce'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.971573 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3364e38dc6734c8d950bb654a1e4084b', 'request_id': 'req-9a80bbf8-f5be-4740-a16b-a572271ea8ce'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.978197 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3364e38dc6734c8d950bb654a1e4084b', 'request_id': 'req-9a80bbf8-f5be-4740-a16b-a572271ea8ce'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.990891 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] The token cache is being invalidate because project 3364e38dc6734c8d950bb654a1e4084b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:08:41.991186 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.991835 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:41.993444 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1427/2885] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:08:41 2022] DELETE /identity/v3/projects/3364e38dc6734c8d950bb654a1e4084b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:42.007444 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f3dc5d9c6648c79267f71b5a86f249', 'request_id': 'req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.014846 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f3dc5d9c6648c79267f71b5a86f249', 'request_id': 'req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.023724 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f3dc5d9c6648c79267f71b5a86f249', 'request_id': 'req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.037263 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] The token cache is being invalidate because project d2f3dc5d9c6648c79267f71b5a86f249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:08:42.037566 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.038259 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.039869 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1459/2886] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:08:41 2022] DELETE /identity/v3/projects/d2f3dc5d9c6648c79267f71b5a86f249 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 15:08:42.044246 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:42.045910 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:42.118655 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80bbf8-f5be-4740-a16b-a572271ea8ce admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:42.175208 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:42.185326 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:42.186663 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:42.187360 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:42.187937 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] PATH_INFO: `/v3/users/46ef905ab0e44227bff55b4074de59d2` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:42.189377 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ef905ab0e44227bff55b4074de59d2)` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:42.191442 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:42.248216 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ef905ab0e44227bff55b4074de59d2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.248924 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ef905ab0e44227bff55b4074de59d2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.261270 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ef905ab0e44227bff55b4074de59d2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.268082 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ef905ab0e44227bff55b4074de59d2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.268713 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.notifications [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ef905ab0e44227bff55b4074de59d2'} {{(pid=86728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.282111 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1428/2887] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 18 15:08:42 2022] DELETE /identity/v3/users/46ef905ab0e44227bff55b4074de59d2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:42.453932 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:42.455443 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:42.468719 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3c5ab-d0fd-427d-a140-b69f6443ad81 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:42.525273 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb17e1228d44efb843bda521c27b495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e866db7b1bd46b4b3abe110fcb71b70', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:42.526108 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:42.526398 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:42.526680 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] PATH_INFO: `/v3/projects/e79bc9f8860a4c9a868621d4359c8097` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:42.527865 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79bc9f8860a4c9a868621d4359c8097)` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:42.529793 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:42.577381 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79bc9f8860a4c9a868621d4359c8097', 'request_id': 'req-46918587-db73-4aa2-9ecf-485efcd34e24'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.583734 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:42.585079 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79bc9f8860a4c9a868621d4359c8097', 'request_id': 'req-46918587-db73-4aa2-9ecf-485efcd34e24'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.593764 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79bc9f8860a4c9a868621d4359c8097', 'request_id': 'req-46918587-db73-4aa2-9ecf-485efcd34e24'} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.607094 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] The token cache is being invalidate because project e79bc9f8860a4c9a868621d4359c8097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 15:08:42.607385 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.608044 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.notifications [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 15:08:42.609668 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1460/2888] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 18 15:08:42 2022] DELETE /identity/v3/projects/e79bc9f8860a4c9a868621d4359c8097 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 15:08:52.278362 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:52.603235 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG dbcounter [-] [86727] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:08:56.294972 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Authenticating user token {{(pid=86728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:08:56.296433 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:56.386050 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05314816-c617-431a-99f2-054da2cee7d9 admin admin] Validating token access rules against request {{(pid=86728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:08:56.444340 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273becca-ece3-4749-bf17-59dd220a0608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:08:56.445101 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273becca-ece3-4749-bf17-59dd220a0608 service placement] REQUEST_METHOD: `GET` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:08:56.445397 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273becca-ece3-4749-bf17-59dd220a0608 service placement] SCRIPT_NAME: `/identity` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:08:56.445681 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273becca-ece3-4749-bf17-59dd220a0608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:08:56.447581 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.fernet_utils [None req-273becca-ece3-4749-bf17-59dd220a0608 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:08:56.458860 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273becca-ece3-4749-bf17-59dd220a0608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:08:56.460453 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273becca-ece3-4749-bf17-59dd220a0608 service placement] RBAC: Authorization granted {{(pid=86728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:08:56.471113 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: [pid: 86728|app: 0|req: 1429/2889] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:08:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 15:09:06.466706 dv-cinder-839987-7-iscsi devstack@keystone.service[86728]: DEBUG dbcounter [-] [86728] Writing DB stats keystone:SELECT=67 {{(pid=86728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 15:14:03.300339 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Authenticating user token {{(pid=86727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 15:14:03.301768 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.fernet_utils [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 15:14:03.317985 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46918587-db73-4aa2-9ecf-485efcd34e24 admin admin] Validating token access rules against request {{(pid=86727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 15:14:03.322989 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f9dd-ef87-47e0-803d-29a171a9f419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c316d4242edf4c82afd982127603827c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2316792c91e4ecca634b4255749cbc6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 15:14:03.323607 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f9dd-ef87-47e0-803d-29a171a9f419 service placement] REQUEST_METHOD: `GET` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 15:14:03.323890 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f9dd-ef87-47e0-803d-29a171a9f419 service placement] SCRIPT_NAME: `/identity` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 15:14:03.324167 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f9dd-ef87-47e0-803d-29a171a9f419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 15:14:03.333176 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f9dd-ef87-47e0-803d-29a171a9f419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 15:14:03.334732 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f9dd-ef87-47e0-803d-29a171a9f419 service placement] RBAC: Authorization granted {{(pid=86727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 15:14:03.344442 dv-cinder-839987-7-iscsi devstack@keystone.service[86727]: [pid: 86727|app: 0|req: 1461/2890] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 18 15:14:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)